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A FACTORIAL 


STUDY OF TEACHING ABILITY 


HARLEY ELLWOOD ERICKSON * 
Superior State College , 
Superior, Wisconsin | d 


SECTION I 
INTRODUCTION 


MANY STUDIES of a followup nature have 
been made of graduates of teacher training curric- 
ula to determine the success of these persons 
às teachers. Such studies have been, in one 
manner or another, concerned with the assess" 
ment and measurement of teaching ability. That 
Such evaluation is necessary has been pointed 
out many times. Barr! says “ше measurement 
of teaching ability is important: (1) in the train- 
ing of teachers in service; (2) in the institution- 
al training of teachers; (3) in the administration 
of the teaching staff; and (4) in research relat- 
ing to these fields.” Teacher training institu- 
tions are confronted with the dual problem ofre- 
cruiting and selecting those candidates who seem 
to show the greatest promise of becoming 8407 
cessful teachers and of providing those curric- 
ular and extra-curricular activities which will 
aid these candidates when they have entered the 
teaching profession. Evaluation is important in 
both, 

Recent years have seen the role of us teach- 
er undergo significant changes. Baxter? points 
out: “Tt ig no longer enough that the teacher be 
the possessor of knowledge. Today's teacher 
must be a ‘social engineer’, capable of setting 
up a provocative environment for children’s 
learning, charting the course of each individual 
child through the ever-changing social relation- 
Ships in which he is involved and assisting each 
Pupil to grow in his understanding of himself and 
of others," One can readily realize the impli- 
cations of statements such as this for the re- 
cruitment, selection, training, and placement 


* The author has incurred many 
Barr, his major professor, Ї г 
the course of this investigation. 


1. Arvil S, Barr. 
(Aprii 1935), оре 561. 


of teachers. 

Many persons have attempted to construct 
instruments of one sort or another that might 
be used in teacher evaluation. As yet, educa- 
tors have not, however, reached agreement 
concerning what constitutes an adequate criter- 
ion of teaching success. In general, research 
studies have employed criteria of the following 
types: (1) а rating assigned by the principzl or 
superintendent; (2) a rating by the teacher's 
supervisor or a visiting supervisor; (3) an еуа1- 
uation of the teacher by the pupils; and (4) an 
evaluation by the teacher's peers. Less 1ге- 
quently a criterion of pupil gain has been used, 
but when this has been utilized the gains have 
been expressed as difference scores obtained 
by subtracting a final test score from a pre-test 
score. Most educators would agree that the 
teacher should provide an atmosphere which 
will foster desirable growth in students, but 
they would not all agree that this growth is to 
be assessed only by achievement tests in sub- 
ject matter areas. On occasion а self-evalua- 
tion has been advocated and used. Often a com- 
posite criterion has been formed by combining 
several of these criteria. 

Another problem confronting researchers is 
that of determining those traits or characteris- 
tics which appear to be related to teaching suc- 
cess. That many of these traits probably lie 
outside the area of subject matter competence 
has been pointed out by Olson? in his comments 
on various studies made of teachers: ‘‘It is in- 
teresting and significant in the various studies 
that knowledge of the subject matter as such 
seems to be taken for granted and that the suc- 
cess or failure of a teacher appears to Це more 
largely in personal qualities and social relation- 


obligations in carrying out this study, in particular to Dr. А. 5. 
or his constant encouragment, assistance, and leadership throughout 


nthe Measurement of Teaching Ability," Journal of Educational Research, XXVIII 


2. В. Baxter. Teacher 11 Relationships (New York: Macmillan Coe, 1950). 


3. Willard C. Olson. Child Development (Boston: D. 0. Heath. & Coo, 1919), p. 285. 


Ships. " 

That such qualities might be related to the 
temperament or personality of the teachers was 
pointed out in a UNESCO pamphlet:4 “Various 
research studies show clearly that the emotion- 
al stability of teachers affects that of pupils. 
What happens to boys and girls in school ае- 
pends in large measure on the personal growth 
and development of the teachers with whom they 
have to, work. Unhappy, frustrated, dissatisfied 
teachers cannot help their pupils to become 
happy, well-adjusted young people. ”’ 

Statement of the Problem 

This dissertation is concerned with the rela- 
tionships between Supervisory estimates of teach- 
ing success and various measures of teacher 
achievement, temperament, and personality. 

Specifically this study is concerned with de- 

veloping equations for the prediction of teaching 
Success with a minimum number of variables 
апа maximum Stability as suggested by factor 
analysis of a variety of measures of teacher 
vharacteristics and efficiency. In order to де- 
velop а basis for simplified patterns of predic- 
tion a factorial Study is made of the interrela- 
tionships among variables. This is done to de- 
termine factors common to estimates of teach- 
ing success and data-gathering devices common- 
ly employed to measure the achievement, tem- 
perament, and personality of teachers, 


In brief, this study will attempt to answer the 
following questions: 


1. Will a general factor account for the ma- 


trix of intercorrelations of the nine estimates 
of teaching success ? 


2. How many common factors are 


to account for the intercorrelations of the nine 
estimates of teaching success? 


3. Will estimates of these factors in the form 
of facto: basis for separati 


necessary 


wana E 


he U. Ne E. S. С. 0. The Education апа Тгаіпіп, 
Se John Schmid, Ji, "Factor Апал: 
с JSes of Pros 
Education, XVIIT (June 1950), рр. 287-319. T 
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SECTION П 
DESIGN OF THE STUDY 


Description of the Subjects 


SIXTY-FOUR teachers engaged in their 
Second year of teaching in Wisconsin high m 
Schools were chosen for this study. These six 
ty-four cases area sub-group of the total group 
of 101 beginning teachers visited during the be 
ginning teacher visitation program conducted " 
the latter half of the first semester of the Је 
1951 school year. Those visited had graduate 
from the University of Wisconsin in 1950 with _ 
the University Teachers Certificate and had ob 
tained their first teaching positions in the State 
of Wisconsin in the fall of the year 1950. The 
thirty-seven teachers not included for st udy d 
have left the teaching profession: some шагг160, 
others became members of the armed forces, 
and several went into other vocationalareas. | 
The sixty-four remaining cases consist of thirty 
four male and thirty female teachers. 

These teachers represent nineteen fields of 
major preparation. A tabulation of the majors 
and minors will be found in Table I. Twenty- 
eight subject areas are represented for which 
these teachers meet University of Wisconsin 
major or minor requirements or State of Wis- 
consin minor field certification requirements. 
The total frequency of majors is 67 as contrast- 
ed with the 64 teachers. This apparent discrep 
ancy arises since teachers numbered 15 and 46 
had double majors of History and Economics, 
and teacher No. 47 had a double major of Speech 
and English. 

The mean total grade point average for the 
group of sixty-four teachers studied was 1. 94 
with a standard deviation of -40. This com- Ж 
Pares very well with the mean of 1. 88 and stand 
ard deviation of . 38 calculated for 205 (1949) 
School of education graduates and holders of the 
University Teachers Certificate. This group 
does not appear markedly different from the 
1949 graduates in terms of means and standard 
deviations. It cannot be determined whether this 
comparison would hold over a period of years; 
Since statistics are not available. However, 
Schmid? in а study of 102 (1948) graduates ге- 
ported a mean of 1.75 anda standard deviation 
of . 40 for total grade point average, e 

The mean Total Score Percentile Rank on th 


of Teachers Toward World Understanding, 
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TABLE I 


ACHERS 
BULATION OF MAJORS AND MINORS FOR THE 64 TE 
TA 


Z 
i Minors 
ity Majors University Minors i e A 
Universi "- wen 
l Female Total Male Female Total ta 
Subject Area Male 


15 9 24 
English 


History 


1 
5 2 
6 Зан 
American Instit. | 
1 


"UT 
ел 
| 


Agriculture 
Physical Educ. 1 


|||=е 
wa 
ня | | зэ 


Ч 
Home Economics == 4 4 
Business Educ. 1 >” 1 
Physics 1 = 1 
Chemistry 1 4 3 
Natural Science a 


11111 
е | Il 
| 
| 
1-111 


1 2 22 
2 2 2 2 5 5 — 
French 1 1 i 1 1 
Spanish Ат 1 2 == ES Мы ы 
Speech 1 2 2 — я à 1 
Speech Correction — Es 2 5 

Economics 2 


1 4 
Art Education 3 Мы 1 
Sociology 1 = 1 
Music 1 1 1 


ЕЯ 
o 
| 
- 


, Recreation 
General Science 


Political Science == = 
Mathematics та = 

otany — — 
Biology m = 
German m 


Geography 


Zoology = = 
Italian = 


47 
0 67 30 22 52 25 22 
Total 37 3 
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American Council on Education Psychological 
Examination is 50,3. Bach? ша study involv- 
ing seveniy-six 1950 graduates obtained a mean 
of 55. € while Lamke? reported a mean ACE per- 
centile score of 72 for thirty-two 1950 graduates. 

The mean percentile rank in high school 
class is 75.1. 

It is thought that this group is reasonably rep- 
resentative of recent School of Education grad- 
uates at the University of Wisconsin. 


The Data -Gathering Devices Employed 


Forty-two variables were used in the analysis 
which follows. Nine of the variables are esti- 
mates of teaching success; seven were derived 
from the Thurstone Temperament Schedule; six- 
teen from the 16 Р.Е. Test; and the remaining 
ten from University records. 

The forty-two variables are listedbelow. The 
number preceding each measure is used to ident- 
ify that variable in subsequent correlation and 


factor matrices. A code symbol follows each 
measure, 


Х, Acceptability rating by principal PA 

2. Principal's M-blank rating (151уеаг) PM1 
3. Supervisor I M-blank rating SIM 
4. Supervisor II M-blank rating S2M 
5. Principal's M-blank rating (2nd year) PM2 
5. Teacher rating by an outside agency 

9n à special rating form 

7. Teacher's self evaluation SE 
98. Peer evaluation 


PE 
9. Pupil evaluation PuE 
10. Active (Thurstone) A-T 
11. Vigorous (Thurstone) v-T 
12. Impulsive (Thurstone) I-T 
13. Dominant (Thurstone) D-T 
14. Stable (E for emotionally Stable) 
. (Thurstone) E-T 
15. Sociable (Thurstone) S-T 
16. Reflective (Thurstone) R-T 
17. Cyclothymia VS. Schizothymia 
(16 Р.Е. Test) A 
18. General Intelligence vs, Mental 
Defect (16 Р.Е, Test) B 
19. Emotional Stability or Ego Strength 
VS. General Neuroticism 
(16 Р.Е, Test) с 
20. Dominance ог Авсепдапсе vs. 
Submission (16 Р.Е, Test) E 
21. Surgency vs, Desurgency 
(16 Р.Е. Test) F 
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22. Positive Character vs. Immature | 
Dependent Char. (16 Р.Е. Test) G 
23. Adventurous Cyclothymia vs. In- 
herent Withdrawn Schizothymia 
(16 P.F. Test) H 
24. Emotional Sensitivity vs. Tough 
Maturity (16 P.F. Test) I 
25. Paranoid Schizothymia vs. Trust- 
ful Accessibility (16 Р.Е. Test) 
26. Bohemianism vs. Practical Con- 


L 

cernedness (18 P.F. Test) M 
2 

N 

[o] 


Sophistication vs. Rough Simplic- 
ity (16 P.F. Test) 
28. Worrying Suspiciousness vs. Calm 

Trustfulness (16 P.F. Test) 
29. Radicalism vs. Conservatism 

(16 Р.Е. Test) G1 

30. Independent Self-Sufficiency vs. 

Lack of Resolution (16 Р.Е. Test) 02 
31. Will Control and Character 

Stability (16 Р.Е. Тез) 93 
32. Nervous Tension (16 Р.Е. Test) 04 
33. Practice Teaching grade in Educa- 


tion 75 РТ15 
34. Ргасїїсе Teaching grade іп Educa- 

tion Methods Course рар 
35. Grade in Education 73 си 
36. Grade іп Education 74 67 
37. Lecture Section Grade, Education 

15 1,075 
38. Percentile Rank іп High School 

Class PRHS 


39. American Council on Education Psy- 
chological Examination Percentile 
Rank 

40. Freshman-Sophomore Grade Point 
Average Fr. -50. GPA 

41. Juhior-Senior Grade Point Average 

Jr.-Sr. ОРА 

42. Composite: 2 credit major Educa- 
tional Methods lecture Section grade 
and 2 credit minor methods grade 


ACEPR 


ЕМ4 


Sources of Data 


The following data were obtained from the 
beginning teacher visitation folders: 


1. Principal's Acceptability rating. = 
2. Principal's rating on the Wisconsin Адар 
tation of the M-Blank. 


3,4. Two visiting Supervisor's ratings 0n 
the M-Blank, 


The following estimates of teaching succes? 


6. Jacob 0. Bach, 
Dissertation, 


Practice Teachi 
University of wi 


7. Tom А. Lamke. "Persona! 
1951), pp. 217-259, 


lity and Teaching Success, 


Journal of Experimental Education, ХХ (December 


September, 1954) 


were obtained during the 1951-1952 school year: 

5. Principal's evaluation using the Wisconsin 
Adaptation of the M-Blank. 

6. Rating of the teacher by an outside agency 
on a special rating form. 

7. Self-evaluation. 

8. Peer evaluation. 

9. Pupil evaluation. 


Data for assessing temperament traits were 
obtained by administering the Thurstone Temper- 
ament Schedule to each subject. (Variables 10 
through 16. ) 

Data for assessing the sixteen source traits 

7 0f personality were obtained by administering 
the 16 Personality Factor Test to each teacher. 
(Variables 17 through 32.) 

The following data were obtained from Uni- 

versity records: 


33. Practice Teaching grade in Education 75. 

34. Practice Teaching grade in Education 
Methods Course. 

35, 36, and 37. Grades in Education 73, Ed- 
ucation 74, and Lecture Section grade in Educa- 
tion 75, 

38. Percentile rank in high school class. 

39. American Council on Education Psycho- 
logical Examination Percentile Rank. 

40. Freshman-Sophomore Grade Point Av- 
erage, 

41. Junior-Senior Grade Point Average. 

42. Lecture Section grade in major methods 
Course and grade in 2 credit minor methods 
Course, 


Description of the Measures Used . 


TD Principal's acceptability rating, PA— 

15 criterion was cooperatively defined by 
Lamke8, Ringness9, and Bach! to be that qual- 
ity of the teacher which leads other people to feel 
Jat she should be retained in her present posi- 
lon or possibly promoted to a more responsible 
assignment. In the fall of 1950, teams of visit- 
ing Supervisors from the University of Wiscon- 
Sin visited each beginning teacher. One grad- 
uate student from a core group of six graduate 
Students was usually included in each team of 

© Supervisors which visited each teacher 
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during the same class period. , This graduate 
student conducted the interview with the prin- 
cipal to obtain the acceptability rating. The fol- 
lowing typical questions were asked at the end 
of the interview: 

1. How do you like this teacher? 

2. Does she get along well with the students ? 

3. Do the parents feel the same way as the 
pupils do about the teacher? 

4. Is the teacher happy here? Doessshe 
have friends on the faculty, in the community, 
etc? 

5. What strengths or weaknesses does this 
teacher have? 

6. In terms of beginning teachers with whom 
you have worked in the past and in light of our 
discussion as a whole, would you consider this 
teacher as (1) among the best, (2) above aver- 
age, (3) average, (4) below average, or (5) fail- 
ing as a beginning teacher? 4 


Тһе principal was thus led to consider some 
of the teacher's more important relationships 
before he was asked for his acceptability rat- 
ing which is his response to question (6). A 
low score indicates a high rating. 

2. Principal's M-Blank rating (1st year), 
РМ1--А two-page form of the Wisconsin Adap- , 
tation of the M-Blank was used during the be- 
ginning teacher visitation program (see Appen- 
dix B)*. The principal was asked for his rat- 
ing of each teacher using this form. The “Сеп- 
eral Evaluation" rating was the score used in 
this study. The categories on a five- point 
scale were as follows: (1) outstanding, (2) above 
average, (3) average, (4) below average, and 
(5) poor. A low score indicates a high rating. 

3. Supervisor I M-Blank rating, S1M, and 

4. Supervisor II M-Blank rating, S2M — 


As indicated previously, one graduate student 
of the core group was usually included on each 
visitation team. Тһе rating assigned by this 
student was classified as Supervisor I rating 
and the rating of the other visiting supervisor, 
Supervisor П. In several cases, two students 
of this core group formed the team. Inthese 
instances the Supervisor I and Supervisor II 
ratings were classified alphabetically. In the 
case of each of these ratings a low score indi- 


8. Ibid, 


9. Tom А. Ringness. Relationships Between Certain Attitudes Towards Teaching and Teaching Success, 
Ph.D. Dissertation, University of Wisconsin, 1921. 


10, Op. cit, 


* All references to Appendices may be found in original thesis on file in Library, University of 


Wisconsin, 
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cates a high rating. 

5. Principal’s M-Blank rating (2nd year), 
PM2—A form letter anda one-page form of the 
Wisconsin Adaptation of the M-Blank (see Ap- 
pendix C) was sent to each principal in January 
of this year. The rating under the item “Сеп- 
eral Evaluation" was the score used in this 
study. A low score indicates a high rating. 

5. Teacher rating by an outside agency ona 
Special rating form, SPR—A low score indicates 
a high rating. 

7. Teacher's self-evaluation, SE— Harold 

- M. Anderson of the University of Colorado adapt- 
eda pupil evaluation form develped by Bryan 
for use by pupils, peers, and the teacher. The 
Teacher’s Self Evaluation form (see Appendix 
D) was sent to each teacher during the past 
school year. The overall evaluation (item 10) 
was the score used in this study. The categor- 
ies of item 10 were as follows: (1) best, (2) зес- 
ond, (3) middle, (4) fourth, and (5) lowest. A 
low Score indicates a high rating. 

8. Peer evaluation, PE—Two fellow teachers 
were sent a form letter asking them to rate the 
teacher using the Peer Evaluation of Instruction 
Form (see Appendix Е). Ап attempt was made 
to have each teacher rated by one male and one 
female colleague. Those asked to rate the tea- 
cher were chosen, using the Official Wisconsin 
School Directory, from the same subject area, 
insofar as possible, as the teacher to be rated. 
The response to item 9 with the following cate- 
gories, upper, Second, middle, fourth, and low- 
est, was the rating used in this Study. The sum 
of these two peer ratings was the peer evaluation 
Score used. A low score indicates a high rating. 

9. Pupil evaluation, РаЕ--Еасһ teacher's 
principal was sent a form letter and five Pupil 
Reaction to Instruction forms (see Appendix F). 
He was asked to secure the reactions of five 
Students chosen at random from one of the clas- 
Ses taught by the teacher, 
his completed form in a se 
furnished by the Teacher 
Committee, Тһе sum of 


Я 

а the pupil evaluationrat- 

ing Score used іп this st 

dicates a high rating. 
Before passing on to 

data gathering devices 

certain terms. 


the description of other 
it might be well to discuss 


What is teaching Success? 
Educators ag 


ree that teachi 
and complex act 


ng is an exacting” 
* Certain co 2 


mponents such as 


11, Arvil 5. Barr. "The 1 


Measurement of T 
(April 1935), рр. 568 ва 


hing Ability, 
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the unique physical setting of the teaching өлен 
ation, and Ше presence of one or more P enin 
in this setting are prerequisites to the teac ы 
act. Each individual, including the teac ие: 
brings to such а setting his own unique pa реже 
of behavior. No two teaching situations = es 
actly alike due to the complex and intrica а ad 
terplay of these unique components. By be 
large, a teacher ina given situation ея - 
judged successful or unsuccessful, effecti om 
ineffective, in terms of how he adjusts me фэн 
unique pattern of behavior to the unique р шең а 
setting and to Ше unique behavioral patter 
those with whom he has contacted. ыйан 
The terms ‘‘successful’’ and М мет! аге 
applied to teachers need по! be and proba : 
not synomous. И by an effective teacher Wí А 
mean one who provides ап atmosphere ic 
will foster desirable growth in pupils, mei 
agreement would be needed оп what desira d 
pupil changes we wish to measure and ЖЕР т? 
тіпе теапѕ ої assessing these. Barrllin ch" 
35 stated: ‹‘.... the ultimate criterionof пећ 
ing success will have to be found in the um ob- 
produced in pupils measured in terms of t pro" 
jectives of education.... These changes A Hl 
ducts of instruction will have to be consideri is 
broadly. We shall have to take into consider 
tion not merely knowledges and skills and tti- 
more tangible outcomes of instruction but а ев 
tudes and ideals and the less tangible pe 
of instruction. ” If this could be done the degr _ 
of effectiveness of а teacher could be шин” 
ined according to prescribed standards. UP re 
the present time this has not been adequately Be 
complished for any grade level or for any d 
ject matter area. Effectiveness so determi dm 
could be considered either as an index of 59 


i | рай 
cess ог as ап index of effectiveness for th 
teacher, 


Success is a broader term that not only in 
volves the teacher as a director of learning n 
also involves the teacher as a friend and get 
Selor of pupils, as a member оға professio 
Staff, and as a citizen ina community. ТО not 
Successful in this broader sense, a teacher. n 
only must produce desirable changes in Быр Нот 
but he must be acceptable to the administra ад 
to his peers, to the pupils, to the parents; tto 
to the community. Many people will feel p ет 
be effective (as defined in this study), а tea 
must possess these broader competencies. Р 

The evaluations and judgments made un e 
teachers by principals ànd supervisors СО odd 
to be important in education. Very oftenth 
evaluations are given in the form of ratings | 
Such as those used in this study. On the ba 


of such ratings teachers often are promoted, 


" Journal of Educational Research, XXVIII 


September, 1954) 


аге given pay increases, and are granted Исеп- 

ses and certificates. Such а rating is therater’s 
opinion of the teacher expressed as a value judg- 
ment. The question of reliability does not arise? 
if we view this rating as the rater's judgment of 

this teacher's effectiveness relative to the time 

and to the specific situation in which she was 


. Observed. The question of reliability may arise, 


however, if at some later date the same rater 
is asked to rate this same teacher again using 
the same rating instrument. И one asks the 
Question: “о the two ratings agree?” a question 
of reliability clearly arises. If the two ratings 
do not correlate highly we cannot be sure wheth- 

^ er this lack of agreement is due to a change in 
the rater, a change in the ratee, or a change in 
the interpretation or application of the instru- 
ment, 

Each of the ratings used in this study were 
obtained as judgments of the principal, a visit- 
Ing supervisor, the teacher's peers, and the 
Pupils taught by the teacher concerning. the ef- 
fectiveness of a particular teacher at a particu- 
lar time ina particular situation. The specific 
instruments utilized to obtain these judgments 

lave been described in detail earlier in this sec- 
lion. In this study we will study the interrela- 
tionships found to exist between these several 
rating judgnients to determine if these judgments 
аге measuring different factors. Described 
next are certain measures of temperament. 

10. through 15. Thurstone Temperament 
Schedule, TTS— This questionnaire was devel- 
ped to show types of temperament. Seven аг” 
€as of temperament are appraised by questions 
pertaining to likes and dislikes, preferences and 
habits, in everyday life. The schedule contains 
140 such questions. The twenty items scored 
for each area are scattered throughout the sched- 
Ше, The testee answers each question with Yes, 
No, or 2. However, only the Yes or No ге- 
Sponses score ona self-scoring answer pad ac- 
Companying the booklet. A copy of the Thurstone 

emperament Schedule and the mimeographed 
letter of instructions sent to each teacher are in- 
Cluded in Appendix G. 

Test-retest reliabilities for these seven 
temperament areas were computed for 81 male 
executives. Тһе retests were given within six 
months of the first administration. The relia- 
bilities were: А, 0. 78; У, 0. 78; 1, 0.79; р, 
0.82; E, 0.61; S, 0. 73; апав, 0. 75. 

Split-half reliabilities corrected by theSpear- 
man Brown formula for 200 college men were: 
А, 0.48; V, 0.61; I, 0.65; D, 0.77; E, 0.83; 

S, 0. 68; R, 0. 73. Split-half reliabilities com- 
buted for 157 college women in a similar man- 
ner were: А, 0.46; V, 0.63; L 0.69; D, 0. TT; 
E, 0.64; 5, 0.73; and R, 0. 62. 

The Seven areas of temperament assessed 

by this Schedule are described below. These 
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descriptions are quoted from the Examiner Man- 
ual for the Thurstone Temperament Schedule. 
10. Active, А-Т 

A person scoring high in this area usually 
works and moves rapidly. He,is restless when- 
ever he has to be quiet. He likes to be ‘‘on the 
го”? and tends to hurry. He usually speaks, 
walks, writes, drives, and works rapidly, even 
when these activities do not demand speed. 


11. Vigorous, V-T 4 
A person with а high score in this area par- 


ticipates in physical sports, work requiring the 
use of his hands and the use of tools, and out- 
door occupations. The area emphasizes phys- 
icalactivity using large muscle groups and 
great expenditure of energy. This traitis often 
described as masculine", but many women 
and girls will score high in this area. 


12. Impulsive, I-T ° 
High scores in this category indicate а happy- 


go-lucky, daredevil, carefree, acting-on-the ~ 
spur-of-the-moment disposition. The person 
makes decisions quickly, enjoys competition, 
and changes easily from one task to another. 
The decision to act or change 15 quick regard- 
less of whether the person moves slowly or rap- 
idly (Active), or enjoys or dislikes strenuous 
projects (Vigorous). A person who doggedly 
‘hangs оп” when acting or thinking is typically 
low in this area. 


13. Dominant, D-T 

People scoring high on this factor think of 
themselves as leaders, capable of taking initi- 
ative and responsibility. They are not domin- 
eering, even though they have leadership abil- 
ity. They enjoy public speaking, organizing 
social activities, promoting new projects, and 
persuading others. They are the ones who would 
probably take charge of the situation in case of 
an accident. 


14. Stable (Е for emotionally stable), E-T 
Persons who have high scores usually are 
cheerful and have an even disposition, They сап 

relax та noisy room, and they remain calm in 
acrisis. They claim that they can disregard 
distractions while studying. They are not irri- 
tated if interrupted when concentrating, andthey 
do not fret about daily chores. They are not an- 
noyed by leaving a task unfinished or by having 
to finish it by a deadline. 


15. Sociable, S-T 

Persons with high scores in this area enjoy 
the company of others, make friends easily, and 
are sympathetic, cooperative, and agreeable in 
their relations with people. Strangers readily 


tell them about personal troubles. 


16. Reflective, R-T 

High scores in this area indicate that a per- 
son likes meditative and reflective thinking and 
enjoys dealing with theoretical rather than prac- 
tical problems. Self-examination is character- 
istic of reflective persons. Тнезе people are 
usually quiet, work alone, and enjoy work that 
requires accuracy and fine detail, They often 
take on more than they canfinish, andthey would 
rather plana job than carry it out. 


The following consideration regarding the 


use of the term temperament was thought im- 
portant for this study. 


Allporti2 speaks of tem 
certain class of raw mater 
Sonality is fashioned. 
is no temperament apa 
any personality devoid 
makes the following de: 
“Тешрегашеп! refers 
Omena of an individual’ 
cluding his susceptibili 
tions, his customary s 
Sponse, the quality of 
all peculiarities of flu i 


perament as being a 
ial from which per- 
“Strictly speaking there 
rt from personality, nor 
of temperament, " Не 
finition of temperament:i3 


fore largely heredita 
of temperament аззе 
perament Schedule w. 
Study. Seven areas о 
ed by this questionnaire, 
that his schedule was ''.... designed to assess 
those traits which are relatively permanent for 

each person.... It is limited to a practical de- 

Scription of important aspects of temperament," 
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choice response with thee 


n- 
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der certain conditions. This recommendation à 
was followed in this study. The questions whic 
Score for each factor are scattered throughout 
the test. A response toagivenquestion contri 
utes to the score of only one factor. 

The split-half reliability of the test on а -— 
sample of 200 of the general population, corr 
ed to the full number of items in the A and B 
forms, is reported in the test manual to be и 10: 
follows for the sixteen factors: A, 0.84; кл : 
С, 0.11; Е, 0.82; Е, 0.85; С, 0.56; Н, 0. T Š 
I, 0.54; L, 0.55; M, 0.72; N 0.65; O, 0.88; Qt 
0.50; Q2, 0.61; ©з, 0.53; Q4, 0.76. Б 

Both forms were administered to each sul x< 
ject. A copy of the 16 P. F. Test and the gun 
eographed letter of instructions sent to еас 
teacher is included in Appendix H. u 

The sixteen source traits of personality 257 
Sessed by the test are described below primar 
ily in terms of questionnaire responses. Th = 
plus pole corresponds to the category listed m 
the left and is denoted by a high numerical cn à 
for that factor. For more detailed descriptio 
of these factors the reader is referredto many 
of Cattell’s written reports (see Bibliography) 
or Guide to Principles and Techniques of cat 
Sonality and Ability Testing, and Handbook fo 
the Sixteen Personality Factor Questionnaire, _ 
The following partial descriptions of these fa 
tors are quoted from the latter publication: 


17. Factor A, Cyclothymia vs. Schizothymia, 4 


А Score of 40 is possible for this factor. 
This factor has been found to load most highlY 
the following traits: sp” 

Good natured, easy going vs. spiteful, gra. 

ing, critical 

Ready to cooperate vs. obstructive 

Attentive to people vs. cool, aloof 

Soft hearted, kindly vs. hard 

Trustful уз. Suspicious 

Adaptable vs, rigid 

Warm hearted vs. cold 


: š 10417 
‚1ш questionnaire responses the А+ ind 


vidual expresses marked preference for ОССО 
pations dealing with people and socially imP 
Sive situatio. 


ings 

ns while the A- person likes Hine 
9r words (particularly material things), wO оа” 
ing alone, intellectual companionship, anda 


), 
(Мен York: Henry Holt & Coes 1931 


for the Thurstone Те 


Тас. 1950), 5. 1 Tament Schedule (Chicago: Science Re- 
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ance of clash of viewpoints. 


18..Factor B. General Intelligence vs. Mental 
Defect, B 
А score of 26 is possible for this factor. The 
measurement of intelligence carries with it as 
а factor in the personality realm some of the 
following ratings: 
Conscientious vs. somewhat unscrupulous 
Persevering vs. quitting š 
Intellectual, cultured vs. boorish 


....and indicating some moderate tendency 
for the more intelligent person to have some- 
what more of the traits which we often callchar- 
acter traits. 


19. Factor C. Emotional Stability or Ego 


Strength vs. General Neuroticism, Ç 

А score of 52 is the highest possible score 

for this factor. This factor loads: 

Emotionally mature vs. lacking in frustra- 
tion tolerance 

Emotionally stable vs. changeable 

Calm, phlegmatic vs. showing general emo- 
tionality 

Realistic about life vs. evasive 

Absence of neurotic fatigue vs. neurotically 
fatigued 

Placid vs. worrying 


This factor is one of good versus poor dyn- 
amic integration of the personality. ... In the 
questionnaire manifestation the C- person 15 


. easily annoyed by things and people, is dissat- 


isfied with the world situation, his family, the 
restrictions of life and his own health. 


20. Factor Е. Dominance or Ascendance уз. 
Submission, Е. 

A score of 52 is possible for this factor. 
Assertive, self-assured vs. submissive 
Independent minded vs. dependent 
Hard, stern vs. kindly, soft-hearted 
Solemn vs. expressive 
Unconventional vs. conventional 
Tough vs. easily upset 
Attention getting vs. self-sufficient 


.... At present no good objective tests exist 
for this factor, since it seems to show itself 
more in human relations than in assertion over 
inanimate difficulties. Тһе chief questionnaire 
responses indicate a tendency to assert oneself 
Socially, to believe that one is right in disagree- 
ments, to borrow or trespass without embar- 
rassment, and to be ready to take а chance in 

ngerous situations. 


21. Factor Е. Surgency ув. Desurgency, Е 
A score of 52 is possible for this factor. 
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This factor loads: » 
Talkative vs. silent, introspective 
Cheerful vs. depressed С 
Placid vs. anxious 
Frank, expressive vs. incommunicative, 
smug В 
Quick, alert vs. languid, slow 


.... The questionnaire responses show Е+ 
to be carefree, happy-go-lucky, fond of bustle 
and excitement, inclined to practical jokes and 
disinclined to occupations requiring close and 
accurate work. There is a significant trend 
from F+ behavior with age. 


22. Factor G. Positive Character vs. Imma- 
ture Dependent Characier, G 
A score of 40 is the highest possible score 
for this factor. 
Persevering, determined vs. quitting, fickle 
Responsible vs. frivolous 
Emotionally mature vs. demanding, impa- 
tient 
Consistently ordered vs. relaxed, indolent 
Conscientious vs. undependable 
Attentive to people vs. obstructive 


....Subjectively the G+ person views him - 
self as correct in, anda guardian of manners 
and morals, persevering, planful, able to con- . 
centrate, interested in analyzing people, cau- 
tious and preferring efficient people to other 
companions. 


23. Factor H. Adventurous Cyclothymia vs. 
Inherent Withdrawn Schizothymia, H 
A score of 52 is possible for this factor. 
This factor loads: 
Gregarious sociability vs. shyness, with- 
drawing tendency 
Adventerous, bold vs. cautious, retiring 
Having marked interest in the opposite sex 
vs. slight interest in the opposite sex 
Frivolous vs. conscientious 
Strong, artistic, or sentimental interests 
vs. lack of same 
Abundant emotional response vs. coolness, 
aloofness 


.... The H- individual reports himself to be 
intensely shy, convinced of his inferiority, slow 
and impeded in expressing himself, disliking 
occupations with personal contacts, preferring 
one or two close friends to large groups and 
not able to keep in contact with all that is go- 
ing on around him. m 


24. Factor I. Emotional Sensitivit 5 
Maturity, I е лив 
А score of 40 is possible for this factor 
This factor loads: аан 


г 


Demanding, impatient vs. emotionally ma- 
ture 


Dependent, immature ув. independent mind- 
ed 

Imaginative, introspective vs. set and smug 

Kindly, gentle vs. hard, cynical | 

Aesthetically fastidious vs. lacking artistic 
feeling 

Frivolous vs. responsible 

Attention getting vs. self-sufficient 


.... Iz the questionnaire realm, such a fac- 
tor has appeared several times and has been 
called self-sufficiency, but as there are two self- 
sufficiency factors, this needs Special descrip- 
tion, particularly since attention-getting appears 
in the alleged self-sufficiency, The individual 
typically shows a fastidious aversion to “сгиде” 
people and occupations but a liking for travel 
and new experiences along with a labile, imag- 
inative, aesthetic mind and a certain imprac- 
ticality in general affairs, 


25. Factor L. Paranoid Schizothymia vs. Trust- 
ful Accessibility L 


A score of 40 is possible for this factor, 
This factor loads: 
Prone to jealous 
cies 
Placid, Shy, bashful vs, composed 
Suspicious vs, trustful 
Dour vs. cheerful 
Rigid уз. adaptable 
Hard and unconcer 
other people 


Y VS. free of jealous tenden- 


ned уз. concerned about 


лан Objectively the indiv 
he is annoyed by people clai 
t he consid 
Son who is Scrupulously co 
He also shows Some intens 
al, mental life, 


idual reports that 
ming to be Superior 
ers himself as арег- 
ггес in his behavior, 
ive interests in intern- 


26. Factor M. Bohe 


mianism vs, Practical Соп- 
cernedness, М 
--тпедпезв, 


А Score of 52 is Possible for this factor, 
This factor loads: 


VS. easil concerned а = 
ргеввїү 7 chin 
Occasional hysterica] i i 
_ ешоЦоп уз. 
keeping De: S. given to 


in emergencies 


+++. There are som i " 
tionnaire of the е evidences in the ques- 
Stability at 


Sleep, 


hers with placidity, 
цас » is oblivious 
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ВИЕ Е 
to convention but can feel childishly dependen 
and insecure episodically. 


21. Factor N. Sophistication vs. Rough Sim 
plicity, N 
А score of 40 is possible for this factor. 
This factor loads: 
Polished vs. clumsy, awkward 
Cool, aloof vs. attentive to people 
Fastidious vs. easily pleased 


.... In terms of the questionnaires, it ur 
been discovered two or three times under Ма: 
ing titles such as intellectual leadership, шан 
headed rationalism, and titles indicating à 


phisticated, intellectual, uns e ntimental ар- 
proach to things. 


28. Factor О. Worrying Suspiciousness vs. 


Calm Trustfulness, O 
en srustuiness 


А score of 52 is possible for this factor. š 
This factor is not very well defined in ratings; 
but loads: Ч 

Worrying, anxious vs. placid, toug m 

Suspicious, brooding vs. trustful, free fro 

Suspiciousness 


In various 


questionnaires it has been very 
well defined a 


nd variously labelled as "серге 
Sive Tendency, ›› ‘‘Moodiness, " ‘Emotional | 
Sensitivity, >” “Self Depreciation, ” and кү 
eral Neuroticism, » It is, however, quite E 
tinct from the general neuroticism factor la 
elled C above, and it may be that it is some 
relatively temporary condition of depression 
and worrying which is not a stable feature e 
the personality, At any rate, it is somewha”. 
decidedly more obvious in the mental interio Е 
of the subject than it is to the observer, > № 
ing him to feel remorseful, downhearted, SU 
ject to phobias and neurasthenic symptoms, 


worrying, avoiding people and perturbed by 
the inconstancy of his own moods. 


29. Factor 91. Radicalism vs. Conservatism, 
231 Барби arc ый 

А 5соге ої 
This factor has not a 


the more гайг 
of actua] attit 
ed in the que 
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the remaining three factors аге not given alpha- 
betical labels because they have not yet been 
demonstrated to appear in the series of factors 
obtainable in ratings. 


30. Factor Qo. Independent Self-Sufficiency vs. 
, Lack of Resolution, 02 


А score of 40 is possible for this factor. As 
Will be evident from the questionnaire responses 
themselves, this factor in its positive loadings 
indicates an individual who is resolute and ac- 
Customed to going his own way, but who is not 
necessarily dominant in his relation to other 
People. The Qg- person prefers to work and 

^ make decisions in company with other people, 
likes social approval and admiration, is conven- 
tional and fashionable. The predictive value 
ем be evident from the occupational аввосїа- 
ions. 


31. Factor Q3. Will Control and Character Sta- 
bility, Q3 

А score of 40 is possible for this factor. 
This factor has some relation to the C and G 
factors described above, yet it is not very evi- 
dent in ratings and is still listed and defined 
Primarily as a factor in the questionnaire re- 
Sponses for mental inferiors. Individuals high 
in this factor show, according to the question- 
naire responses, strong control of emotions and 
behavior. They are inclined to be considerate, 
Careful, and conscientious, but also obstinate. 
Although no behavior ratings have picked outthe 
factor, it has been observed that when people 
Who are high in this factor have been put together 
in groups, the general efficiency and objective- 
ness of the group is decidedly higher than in 
&roups that are only average in the factor. There 
Are indications that persons high in this fa ctor 
аге inclined to mathematical interests. 


32. Factor 94. Nervous Tension, Q4 
А score of 52 is possible for this factor. 

This factor has been found in earlier question- 
naire studies where it has been called nervous 
ness, nervous anxiety and instability, and sleep 
difficulties with somaesthenia. The general рїс- 
ture is that of a person who is tense, fatigued 

ut is unable to remain inactive. The dimension 
Tesembles а common description of what disting- 
ished the hypertensive person. The ratings 
Show some correlation between this factor and 
Strength of interest in the opposite sex, and it 
*S Possible that it is to be explained as a вех 
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suppression factor. Until the research now 

in progress is completed, however, the predic- 
tions from this factor must rest on the'known 
character of the responses, and on whatever as- 
sociations with occupational norms are shown 
below. e 


Personality of the teachers used in this 
study will be assessed by means of the Cattell 
Sixteen Personality Factor Questionnaire. Cat- 
tell makes this statement regarding this ques- 
tionnaire: 15 “The questionnaire thus aims to 
leave out no important aspect of the total per- 
sonality, for the above factors are based on 
even sampling from the personality sphere and 
include abilities (intelligence), temperamental 
factors, and dynamic (character integration) 
source traits." Cattelll6 makes the following 
distinctions between the three modalities of 
dynamic traits (or interests), abilities, and 
temperamental traits: “Dynamic traits are 
characterized by behavior arising from a stim- 
ulus situation or incentive and directed to some 
goal, at which the action ceases. Abilities, by 
contrast, are shown by how well the person 
makes his way to the accepted goals. Dynamic 
traits are thus traits in which performance var- 
ies as the incentive varies; whereas abilities 
can be recognized as those in which perform- 
ance varies in response to. changes in complex-* 
ity. Temperament traits are definable by ex- 
clusion as those traits which are unaffected by 
incentive or complexity. These are traits like 
high-strungness, speed, energy, and emotional 
reactivity, which common observation suggests 
are largely constitutional. ”” 

The first twelve primary source traits of 
personality described earlier in this section 
have been determined by previous research, 
primarily factor analysis, to be shown in be- 
havior ratings, questionnaire or ''self-rating" 
items, and in objective tests. The other four 
primary personality factors have thus far been 
found only in questionnaire responses. 


33. Practice Teaching Grade in Education 775, 
РТ75 

This grade is available опа special сага 
filed in the education office at Wisconsin 
High School. Since suchletter grades usually 
carry plus and minus signs the following 
transformation scheme was used: А = 1; А- = 
2; В+=3; В=4; С-=8. Alowscore indi- 
cated a high grade. 


abs Be Be Cattell and others. Handbook for the Sixteen Personalit; Factor Questionnaire (Champaign, 


linois: Institute for Personality 
16. Raymond В. Cattell. Personality 


ва... 


and Ability Testing), p. 1. 
(New York: McGraw-Hill Book Cos, 1950), p. 35. 
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34. Practice Teaching Grade in Education Meth- 


ods Course, PTEM 
This grade is also filed at Wisconsin High 
School. The letter grades were converted into 
numerical scores using the same procedure as 


that outlined in 33,above. A low score indicates 
a high grade. 


- 35. Grade in Education 73, С73, and 

36. Grade in Education 74, G74 

These grades were obtained from the under- 
graduate* transcript of credits of these teachers. 
The letter grades were converted to numerical 
Scores by using the following system: A = 14 


B-2:C-3;andD = 4. А low score indicates 
а high grade. 


О convert to numer- 
ndicates а high grade, 


38. Percentile Rank in High 


icalscores, A low score i 


Score indicates а high r i 
graduating class. 


шо. е Same norms were used for 
1 groups. A hi h score indicat 
high level of intelligence." те" 


40. Freshman-go 


System was employed in the 
computation of this grade рој ~ 
ent may register asaj P int average, A stud- 
ucation at the Uni i 
earned a minimum of 58 сг 
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alent number of grade points. The majority of 
the students will register for their fifth sen Е 
ter as juniors. In such cases the num "X cred- 
grade points was divided by the nuniber О Sev- 
it hours to obtain the grade point average. = 
eral cases did not have 58 credits after неа 
Semesters at the University. In these 115 ter 
the grade point average for the fifth pec 
was computed. А sufficient number of “jaded 
and grade points of fifth semester were а ho- 
to yield the minimum of 58 Freshman-Sop vice 
more credits. The fifteen elective war pem 
credits were not included for grade point d to 
computations. They were, however, adde the 
the credits a student had earned to change вх 
student's University classification. И, ан 
ample, a student had earned 28 credits аз was 
Íreshman and during the third semester шон 
granted these 15 war elective credits in e d 
tion to 15 credits of regular work, he леч 
permitted to register for his fourth semes! sh" 
of University study as a junior. But the fr уй 
man-Sophomore grade point average would e 
computed only for the 43 credits he had a pa 
at the University in regular class work. s 

fer credits from other collegiate institutions ы 
were not included in the computation of СРА 


5 ег” 
А high score indicates а high grade point aV 
age. 


41. Junior-Senior Grade Point Average, Jr. ” 
Sr. GPA 


The credits and grade points, exclusive e 
маг elective Service credits, not included 1 
the computation of the Freshman-Sophomort, e 
Grade Point Average were used to compute 


: : һ 
Junior-Senior Grade Point Average. А hig 
Score indicates a high grade point average. 


42. Composite: 2 Credit Major Educational 


Methods Lecture Section Grade and the 2 
Credit Minor Methods Grade, EM4 25 
The two credit major methods lecture Ее, 


tion grade was obtained from the individual 4 
Structors па manner similar to that оч пес. 
for the determination of the lecture grade in 
ucation 75. Тһе 2 credit minor methods gr? 
was obtained from the University transcript. 
Each of these grades were converted to nume 
ical scores with A — 1;B-2;C-3; D- 4. 

Sum of these two numerical scores was the 
Score used for this composite measure. A 10 
Score indicates a high composite grade. 


Proced 


ure to be Followed in Treatment of Data 
Procedure to be Followed in Treatment of Data 
Success in teaching is defined in terms of 
the following ratings: 
1. Principals acceptability rating 
2. Principal's M-blank rating (1st year) t" 
^^ “Wo visiting supervisor’s M-blank га 
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5. Principal's M-blank rating (2nd year). 

6. A rating obtained from an outside agency 
on a special form. 

Л. Teacher's self evaluation. 

8. Peer evaluation. 

9. Pupil evaluation. 


Four types of data were collected for each 
Subject. They were: a)in-service estimates of 
Success; b) теаѕигоѕ of temperament; с) meas- 
ures of personality; and d) pre-service meas- 
ures of achievement. This investigation is pri- 
marily concerned with the relationships between 


^ a) and b), a) and c), and a) and d). 


This study will follow the following proced- 
ure: 

1. The coefficients of correlation for eac h 
pair of in-service estimates of success variables 
will be computed. 

2. The resultant nine by nine matrix of сог- 
relations will be factored by the multiple group 
method to determine factors underlying these 
estimates of teaching success. These hypothet- 
ical factors should provide us with a simpler ех- 
planation of the interrelationships of the teach- 
ing success estimates. 

3. The correlation coefficients of each tem- 
Perament measure, each personality measure, 
and each achievement measure with each of the 
nine estimates of teaching success will be com- 
puted. These correlations will form the entries 
of three rectangular matrixes of orders seven 
by nine, sixteen by nine, and ten by nine гезрес- 
tively, 

4. The grouping of the variables and a pro- 
Cedure similar to that utilized in (2) will be ap- 
plied to these three rectangular matrixes to de- 
termine if such an analysis will account for the 
Correlations in these matrixes. 

5. Factor scores for the factors found in (2) 
Will be calculated for each individual. These 
Scores are estimates of the factors found by the 
analysis in (2). These factor scores willbe used 
4S criteria of teaching success. 

6. Pearson product-moment coefficients of 
Correlation will be calculated for each tempera- 
ment, personality, and achievement variable 
With these obtained criteria. | 

7. Multiple regression techniques will be етт 
Ployed to develop equations for the prediction of 

© criteria. 
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SECTION Ш 
ANALYSIS OF THE DATA > 


IN THIS section the statistical treatment 
of the data will be described. The readers will 
be referred to tables and to selected references 
for more detailed discussions of the statistical 
methods employed in carrying out this study. 

The extreme scores, ranges, means, stand- 
ard deviations, and the number of teachers for 
whom the forty-two measures were obtainedare 
presented in Table II. 

The Pearson product moment coefficient of 
correlation will be used in this study to indicate 
linear relationships existing between various 
sets of scores. 

Factor analysis will be the major statistical 
device utilized in summarizing the correlation- 
al data. 

This section will be divided into six parts. 
Part one will deal with the factor analysis of the 
nine by nine matrix of intercorrelations of the 
nine estimates of teaching success. This nine 
by nine matrix has been designated the R matrix. 

In part two the analysis of the Rx matrix 
(seven by nine rectangular matrix) will be pre- 
sented. This matrix has as entries the correl- 
ations of the seven temperament varia bles, 
numbered in this study 10 through 16, with the - 
nine estimates of teaching success. 

In part three the factor analysis of the rec- 
tangular matrix, of order sixteen by nine, des- 
ignated the Ry matrix, will be discussed. The 
entries in this matrix are the correlations of 
the sixteen personality source trait measures 
(variables 17 through 32) with the nine estimates 
of teaching success. 

Part four will be concerned with a discussion 
of the factor analysis of the Rz matrix. This 
matrix is of order ten by nine and hasas entries 
the correlations of ten preservice measures of 
achievement and intelligence (variables number- 
ed 33 through 42) with the nine in-service esti- 
mates of the factors found in the analysis re- 
ported in part one. These estimates will be in 
the form of factor scores and will be used as 
**composite" criteria in the prediction phase of 
this report. 

Part six will discuss the results of the mul- 
tiple correlation techniques employed to predict 
the factor scores discussed in the preceding part. 
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TABLE II 


; ASES 
ONS, AND NUMBER OF C 
MEANS, STANDARD ОЕУТАТИ ” 
нэх, OF THE FORTY-TWO MEASURES 


High* Low — s. D. No. 
Variable Code Score Score Range = T T 
2 PM1 5 : эрс ups 2 
: SIN Š 1 4 2.53 0. 95 5 
: prar d i 3 2.29 0. 63 63 
| ШЕ d і 1 1.12 1.86 60 
В ан” т 1 2 2.18 0. 66 ~ 
à т з 2 6 4.02 1.45 ер 
0 pus 18 5 13 10.51 3.02 i 
E A-T 18 5 13 12.20 3.34 M 
11 V-T 18 2 16 10. 83 4.38 ^ 
12 I-T 19 5 14 11. 75 3.2 ан 
13 р-т 20 4 16 12. 52 4. 45 = 
- 19 6 3 : 
| “ЖЭ 19 5 14 13.58 3.14 ~ 
16 R-T 19 1 18 8.22 3. 08 за 
17 А 34 8 26 22.56 5. 46 n 
18 B 23 14 9 19. 69 2.08 E 
19 с 48 26 22 36.84 5.00 M 
20 Е 36 6 30 21.86 1.01 сн 
21 Е 50 8 42 29.78 8.38 a 
22 G 36 16 20 25. 89 4. 66 Ч 
23 Н 50 16 34 3.95 8.51 В. 
24 І 30 4 26 17. 16 4. 85 5 
25 L 28 2 26 15.81 5.81 64 
26 M 30 8 22 19.16 5.40 64 
21 N 34 12 22 22.95 оо 84 
28 о 30 0 30 10. 47 8. E 64 
29 Qi 30 8 22 19.31 5. 58 ү 
30 Q; 31 8 23 17.38 ] 
31 9: 38 10 28 26.55 5.64 e 
32 Q, 34 2 32 13.33 1.15 en 
= ven 7 1 6 2.89 1.74 1 
: РТЕМ 8 1 1 2.61 1.78 E 
si о 3 1 2 1.84 0.57 63 
S 28 3 1 2 1.90 0.53 Ч 
37 14615 4 E 3 2.17 0.18 А 
m PRHS 99 15 84 5.70 23.81 6 
is ACEPR 100 8 92 60. 30 25.31 ° 
41 ва 2.80 0.97 1.83 1.78 0.51 
42 EM4 А 2. 88 1.02 1.86 1.99 0.41 4 
12 5 1 3.42 1:00 
ыы шы ak 
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The Use of Factor Analysis 


Before proceeding to the more detailed dis- 
cussion of the findings of this study, the writer 
feels that several brief statements concerning 
factor analysis should be made. 

Holzinger and Harman!7 make this statement 
about factor analysis: ‘‘Factor analysis is a 
branch of statistical theory concerned with the 
resolution of a set of descriptive variables in 
terms of a small number of categories or fac- 
tors. This resolution is accomplished by the 
analysis of the intercorrelations of the variables. 
A satisfactory solution will yield factors which 


' convey all the essential information of the orig- 


inal set of variables. The chief aim is thus to 
attain scientific parsimony or economy of de- 
Scription, ?”? 

This is the first basic problem with w hich 
factor analysis deals. The second basic prob- 
lem deals with the problem of describing the 
factors in terms of the original variables. 

There are many different methods which can 
be used to transform a correlation matrix intoa 
factor matrix. The multiple-group method of 
factoring the correlation matrix was chosen for 
use in this study. This method was fir st pre- 
Sented by Holzinger18 and six months later by 
Thurstone. 19 This procedure is applicable to 
any correlation matrix which can be divided in- 
to sections that are linearly independent. 

Factor analysis in this study was used both 
to determine the factors common to the nine е5- 
timates of teaching success and to determine 
whether these common factors underlie certain 
temperament, personality, and pre-Serv! ce 
measures of achievement and intelligence. The 
results of these analyses will be reported inparts 
One through four. The second basic problem of 
factor analysis involving factor estimates willbe 
discussed in part five. | 

The multiple-group method outlined by Harris 
апа Schmid 20 was closely followed inthis study. 
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Part One: Factor Analysis of the Nine Inser- 
vice estimates of Teaching Success 


The writer doubted if these nine estimates 
were measures of the same factor. It was found 
that a general factor would not account for the 
intercorrelations of the R matrix supporting the 
original contention. It seemed desirable to ob- 
tain a simpler description of these measures. 
That an arithmetical average of the measures 
in the form of a composite might not be a satis- 
factory means of summarizing this data has 
been pointed out by Holzinger. 21 

Factor analysis of the nine in-service esti- 
mates of teaching success was designed to fol- 


low these steps: 
1. Calculation of the matrix of intercorrela- 


tions of the nine estimates of teaching success. 

2. Transformation of this correlationmatrix 
into an arbitrary oblique factor matrix using 
the multiple group method of factoring. 

3. Rotation of this initial oblique вошНой to 
a meaningful primary pattern following the meth- 
od of direct rotation to primary factor structure 
outlined by Harris. 22 

It became evident after the completion of the 
first two steps that the third step would not be 
necessary. 

Pearson product-moment coefficients of cor- 
relation were computed for each pair of thefirsi 
nine variables. The intercorrelations and the 
final communality estimates of these variables 
are presented in Table III. This matrix has 
been labeled the R-matrix for subsequent refer- 
ences. 

After several attempts at grouping the vari- 
ables and using Harris'23 geometrical criter- 
ion of the dimensionality of the common factor 
space, R was finally sectioned into three groups 
as follows: 


ш: 


17. Karl 2. Holzinger and Harry Н» Harmon. Factor Analysis: A Synthesis of Factorial Methods (Chicago: 


University of Chicago Press, 1948), p. 3» 

18 Каг1 А Ё 

У 2. Holzinger. "А Simple Ме по 
257-261. 


19. L. L, Thurstone. "A Multiple Group Method of 
(June 1945), pp. 73-78. 


20. 
Factor Analysis," Journal of 


21. Ката у, Holzinger. "Factoring Tes 


metrika, ІХ (September 1914)» РРе 155-167. 


22. Chester М. Harris. 


(December 1918), рр 149-168. 
2 
ши Chester W, Harris. "Projectio 


tion, XVII (March 1919)» РР» 335-315- 


с А "Further Ар! lication 
hester Harris and John Schmid. Ее ао ЕЕ 5250; XVIII (March 1950), рр. 175-193. 


d of Factor Analysis," Psychometrika, IX (December 1944), pp. 


Factoring the Correlation Matrix," Psychometrika, X 


of the Principles of Direct Rotation in 


+ Scores and Implications for the Method of Averages," Psycho- 
npirect Rotation to Primary Structure," Journal cf Educational Psychology, ХХХЇХ 


ns of Three Types of Factor Pattern," Journal of erimental Educa- 


хкш 
JOURNAL OF EXPERIMENTAL EDUCATION (Vol. 


TABLE III 


INTERCORRELATIONS, COMMUNALITY ESTIMATES AND RESIDUAL MATRIX FOR 
NINE INSERVICE ESTIMATES OF TEACHING SUCCESS 


R MATRIX 
1 2 3 4 5 6 7 8 9 h? 
1 8% 48 4 00 02 -01 01 15 
2 -03 -05 02 Е 5 10 
57 abe 03 05 02. 09 10 02 02 
з 57 57 06 01 Е + 60 
(62) (59) = E өз 92 04 ын 
4 65 61 68 -02 5 
(88 (5) (58) ud E ОБК 
5 43 4 29 29 -03 
(63) (60) (61) (57) = 00 -08 08 65 
6 43 49 24 25 
54 А 0 
(60) (57) (58) (54) (59) 00 08 ын : 
ти 03 05 11 
38 37 30 
(62) (5) (60) GB (6) (8) 2 ын 
8 18 19 09 06 
28 50 2 0 
(56) (55) (54) (51) (55) (55) Si 9 қ 
9 08 15 


-07 
(53) (53) (51) is 
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The correlations of each variable were sum- 
med over the three groups to produce С. Іп this 
case G is a nine by three matrix. The above op- 
eration is equivalent to post-multiplying R by a 
matrix E which has zero and unity elements ar- 
ranged as follows: 


` TABLE IV 
E MATRIX 
I II HI 
i 0 0 
* 0 0 
£ 0 0 
1 0 0 
0 1 0 
0 1 0 
0 1 0 
0 0 1 
0 0 1 


Ф со фл + 


А three by three matrix, Н, Was obtained by 
Summing the columns of G over each group. This 
matrix represents the correlations of each group 
With every other group. In matrix notation the 
above Operations can be summarized as follows: 


ВЕ = С 
Е ЕЕ = Н 


onstructed. 


Next a diagonal matrix W was c 
quare 


This matrix has as elements the reciprocals 
Toots of the diagonal elements of Н. 3 
Тһе С matrix, the Н matrix, and the W matrix 
аге shown in Tables V, VI, and VII, respectively. 
Pre- and post-multiplication of H by W yields 9, 
the matrix of intercorrelations of the group axes. 
This matrix is shown in Table VIII. 
The structure matrix S, is shown in Table IX. 
his matrix was obtained by post-multiplying G 
JY W, and represents the correlations of each var- 
lable with the oblique group factors. Post-multi- 
Plication of $ by ф-1 yields the matrix P. P isthe 
Matrix of coordinates of the variables with ге“ 
Spect to these factors. The matrix P is shown 
іп Table X, The values in P will be called factor 
adings in the remainder of this study. ° 
w he matrix multiplication SP = R+ yields the 
бос by nine matrix of reproduced correlations. 
GR Should note that the matrix multiplication 4 
с Н ТС! will also yield this matrix of reproduce 
Orrelations, The matrix subtraction R = В+ was 
Е Погтед to yield the residual correlations 
пъди in the upper triangle of Table Ш. An cm 
‘ination of these residuals reveals that the c 


ERICKSON 


17 


` 


correlations very well. 

It was not considered necessary to rotate this 
oblique solution to another oblique solution since 
the pattern matrix, P, indicated that each of the 
variables are of complexity one. 

Inferences concerning the nature of the fac- 
tors were made in terms of the number of sig- 
nificant loadings in each column of the pattern 
matrix and the complexities ofthe variables. A 
variable is said to be of complexity one ii it nas 
only one significant loading in the pattern matrix. 
In this study a minimal loading of .30 was re- 
quired for a factor to represent a contribution 
to the variance of a test. Thurstone’s 24 criter- 
ia for uniqueness of simple structure were used 
as a basis of interpretation of the pattern values 
obtained in this study. The pattern values ob- 
tained, without resorting to further rotation and 
change of reference axes, exhibit the properties 
of simple structure outlined by Thurstone. This 
led the investigator to conclude that this solution 
does not differ greatly from a primary ахів во- 
lution since it is the primary pattern in such a 
solution which will exhibit Thurstone's proper- 
ties of simple structure. 

The tentative names and the factor loadings 
on each of these oblique factors were as follows: 


I. Beginning Teacher Rating Scale Factor 
1. PA, Principal's Acceptability 


Rating . 783 
2. РМ1, Principal's M-Blank rating, 
1st year . 811 


3. S1M, Supervisor I M-blank rating .782 
4. S2M, Supervisor II M-blankrating .858 


These four variables have significant factor 
loadings on this factor. Each of the variables 
is of complexity one. The highest loadings are 
for variables 2 and 4. Variables i and 3 have 
practically identical loadings on this factor. 


IL Second-year Rating Scale Factor 
5. PM2, Principal's M-blank rating, 


2nd year .858 
6. SpR, Outside Agency Rating . 641 
7. SE, Teacher's Self Evaluation .536 


Variables 5, 6, and 7 have significant load- 
ings on this factor. Variable 5 has the highest 
loading. Each of these variables is of complex- 
ity one. 


IH. Peer-Pupil Response Factor 
8. PE, Peer evaluation 
9. PuE, Pupil Evaluation 


.561 
. 769 


Variables 8 and 9, both of complexity one 
have significant loadings on this factor. The 


Culateq oblique solution reproduced the original 


9h. r. r, Thurstone. Multiple-Factor Analysis (Chicago? 


University of Chicago Press, 1917), р. 335. 
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TABLE V 


CORRELATIONS OF EACH VARIABLE WITH EACH GROUP 


G MATRIX 


= 
` Е; 
Ж 
н> 
"ін 
о |Б 


2 1.03 0.26 
2. 2.65 0. 93 0. 34 
3. 2.42 0.58 0.02 
4. 2.64 0. 65 0. 07 
5. 1.42 1.57 0.52 
6. 1.41 1.51 0. 67 
7. 0.36 1.05 0.55 
8. 0.52 1.11 0.91 
9. 0. 17 0. 63 0. 86 


TABLE VI 
H MATRIX 
FEN MM --- 
I 10. 45 3.19 0.69 
П 3.19 4. 13 T 
ш 0.69 1.74 Te 
TABLE ҮП 
W MATRIX 
OMEN Er ны 
1, 
3093 0000 e 
П 
0000 
- 4921 0000 
ш 
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TABLE УШ 
ф MATRIX 
I п ш 
1 1.000 ‚486 160 
п. . 486 1. 000 . 644 
ш. 160 644 1.000 


TABLE IX 


CORRELATIONS OF EACH VARIABLE WITH EACH 
OBLIQUE FACTOR 
S MATRIX (STRUCTURE MATRIX) 


I п ш 
As 848* 507 195 
2. 820 458 256 
3. 149 285 015 
4. 817 320 053 
5. 439 773 391 
6. 436 143 504 
Т 111 517 413 
8. 161 546 684 
9. 053 310 646 


*Decimal points omitted 


TABLE X 


COORDINATES OF EACH VARIABLE WITH EACH FACTOR 
P MATRIX (PATTERN MATRIX) 


I 
1: 183% 140 -021 
ЭГ. 811 -029 144 
3. 182 -041 -084 
4. 858 -072 -038 
5. 050 858 -169 
6 113 641 073 
7. -165 536 094 
8. -025 197 561 
9. 025 -197 769 


*pecimal points omitted 
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highest loading (. 769) is for variable 9. 


Summary of the Factor Analysis of Teaching 
Success Estimates 


It was found that a general factor would not 
account for the matrix of intercorrelations of the 
nine estimates of teaching success. 

Three common factors identified as 


1. Beginning Teacher Rating Scale 


* Factor, 
II. Second-Year Rating Scale Factor, 
HI. Peer-Pupil Response Factor 


Were found in t 


he analysis described above. The 
factors are ob 


lique with sizeable correlations be- 
tween Beginning Teacher Rating Scale Factor and 
Second-Year 


Year Rating Scale p 


Sponse Factor (. 64). The correlation betw een 
Beginning Teacher Rating Scale Factor and Peer- 
Pupil Response Factor was low (. 16). All of the 
Correlations are positive. 

From the aboye analysis one must conclude 
that an arithmetic average of these nine estimates 
of teaching Success would not yield a Satisfactory 
composite estimate. 


In the fifth Part of this Section, estimates of 
these factors in the form of factor Scores will be 


obtained and used as **composite'' Criteria of 
teaching Success, 


Part 


Two: The Factor Analysis of the Rx Matrix 


The Correlations of each of t 
ith each of the ni 


Supervisor П 
8, between Soci- 


er i 
оа нэ necessary in 
Zero at the five percent 
Coefficient 01.26 or Тбег is пе 
tistical Significance at the за, ы” 
Subjects used in this Study 4 F 
random Sample. H ~ 


У for sta- 

х, Тһе 64 

9 no represent а 

2 mer, it was decided to use 

s F ciice in analyzing the 

у pus 4 ported above 
Ceptability, 1) a> 
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different from zero by the above ES В 
standards. In addition to these three песни 
tions, seven other correlations are of uer м 
tude .20 or larger. Temperament varia tions 
numbered 11, 13, 14, and 15 had ет 
01.20 or larger with teaching success мүн quite 
6. In general these correlations tend to re 15 
Small. This leads one to conclude that ther 
very little linear relationship between pup 
Seven temperament traits (as assessed by nine 
Thurstone Temperament Schedule) and the 
estimates of teaching success. loyed 
Factor analysis techniques were emp trix 
in analyzing the correlations in the Rx “ mine 
(and also the Ry and Rz matrices) to са дай 
if the three oblique common factors descri lity: 
in part one underlie temperament, persona ni 
and pre-service measures of achievement e 
intelligence. If these factors do underlie $ еш” 
measures then ап analysis similar to that by 
ployed in the analysis of the original nations 
nine matrix should account for the соггеја res” 
in these three rectangular matrixes. If ША е 
idual correlations are Small, then an -— re^ 
tion of the appropriate pattern matrixes im 
veal the temperament, personality, and Ре lg" 
Service achievement variables which have ing 
nificant loadings on the three oblique {саб 
Success factors. Such а procedure seeme é 
Бе а very Straight forward and sensible о T 
Since in this study we are concerned only = 
the relationships between these ївшрегат si i 
Personality and achievement variables and ple: 
mates of teaching success. Thus, for enar" 
We were not primarily concerned with the pet 
correlations of the temperament variables ri^ 
with the correlations of the temperament va 
ables with the personality variables. ne É 
The Rx Matrix was postmultiplied by table 
matrix (Table Ш) to yield the Gx matrix ( was 
The matrix multiplication GxH-1G latio? 
performed resulting ina reproduced corre This 
matrix of order seven by nine labeled Rx: yj 
latter matrix was subtracted from the Rx IR г 
to yield à matrix of residua] correlations ( г 
Вх). This matrix may be found in Table X 1009 
One notes that the residuals with few Kar ее 
аге very small. It thus appears that the t sev" 
teaching success factors do underlie Шезе the 
en temperament traits. The correlations 0 ёс 
temperament variables with these oblique f^ |. 
tors may be found in Table XIV. They wer’ 
tained by the matrix multiplication GxW = 
(Structure Matrix). The Py matrix (Pattern 
Matrix) Showing the coordinates of the 8696 1498 
temperament variables with respect to the 0 tri 
factors is recorded in Table XV, This me 
Was obtained by post-multiplying 5, by Ф tion? 
It is interesting to note that the correla 
a РЫП temperament variables with 
8€ oblique factors are small Variable? 
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TABLE XI 


CORRELATIONS OF SEVEN TEMPERAMENT TRAITS WITH NINE 
ESTIMATES OF TEACHING SUCCESS 


` Rx MATRIX 
1 2 3 4 5 6 1 8 9 

(64)* (61) (62) (58) (63) (60) (62) (56) (53) 

10 -17** -04 -14 -26 -14 15 -14 11 21 
11 12 19 -08 -03 05 24 -09 16 05 
12 18 01 -02 07 15 16 -07 06 -12 
13 26 16 06 17 09 22 12 08 -12 
14 16 16 08 09 06 20 09 04 00 
15 23 18 09 31 12 20 12 -01 -19 
16 08 =01 20 01 -01 03 16 00 -10 


* Number inside parenthesis indicates the size of the subgroup used to calculate the correlations 


"m. that column. 
Decimal points omitted. 


10 
11 
12 
13 
14 
15 
16 


* 5 
Decimal points omitted 


TABLE XH 


CH TEMPERAMENT VARIABLE WITH 


CORRELATIONS OF ЕА 
EACH GROUP 


10 -61* 
п n 24 -06 
12 24 

43 -04 
D е 35 04 
ni ~“ 44 -20 
15 81 

18 -10 
16 28 


*Decimal points omitted 


TABLE XIII 
RESIDUAL CORRELATIONS 


Ry-RX MATRIX 


1 2 3 
-01* 08 03 -09 А 19 18 -02 02 
06 12 -11 agi 
11 -04 -08 02 
07 01 -09 01 
02 04 -03 £ 
00 00 -11 10 
00 -07 13 -06 
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TABLE XIV 


CORRELATIONS OF EACH TEMPERAMENT VARIABLE WITH 
EACH OBLIQUE FACTOR 


Sx MATRIX (STRUCTURE MATRIX) 


I 


п ш 
11 062 098 158 
12 074 118 -045 
13 201 212 -030 
14 152 172 030 
15 251 217 -150 
16 087 089 -075 


*Decimal points omitted 


TABLE ху 


CORRELATIONS OF EACH TEMPER 
AMENT VAR WITH 
RESPECT TO EACH OBLIQUE poU 


FACTOR 
PX MATRIX (PATTERN MATRIX) 


II ш 
10 ~ 
Ti аг -298 451 
-041 176 
12 -020 
264 -212 
13 076 
14 un 345 -264 
15 097 15 ян 
18 -469 
013 226 


-222 
*Decimal points omitted 
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and 14 are positively correlated with eachoblique 
factor axis. 
ч но of the Seven variables have significant 
Lon loadings оп Еасїог 1. Variables 13 and 
Pelri significant loadings on Factor II while 
es 10 and ignifi i 
Factor А 15 have significant loadings on 
" : Should be noted that R& can also be obtained 
y ollowing either one of the following matrix 
multiplications: 


SxP'= R or Px$'- ВХ. 


š бе reproduced correlations of the Ry and 
Батыг matrixes (to be discussed in Ше next two 
the = can also be computed by substituting in 
Ni ign equations the structure and pattern 

S associated with a particular matrix. 


P. 
М Three: Тһе Factor Analysis of Ше В 


Matrix 
ed correlations of each of the sixteen per- 
Of te Шу variables with each of the nine estimates 
hala анар success were calculated. These cor- 
еси are the entries in the sixteen by nine 
Cord ngular matrix labeled the Ry Matrix andre- 
Ag in Table XVI. 
о examination of the Ry Matrix reveals that 
the vee of the eonvelations are negative (75 of 
Corre], correlations). The sign of each of these 
agree ations was changed so that they w o uld 
` ang МВ other correlations, as regards sign 
estimate (A low number for the inservice 
numb ates indicates a high rating whereas а high 
cates th for the personality factor scores indi- 
Corr lie plus pole of the given trait. ) The 144 
glations ranged from -.32 (N - 53, between 
Detwee’ and Pupil Evaluation, 9) to . 38 (N = 38, 
dition to Qs, 31, and Self-Evaluation, 7). Ina 
бле Bio these two correlations, ten correlations 
stanga o icantly different from zero by the 
Кз discussed in Section 2. Including these 
relati Correlations, there are а total of 34 cor 
ес Ons of .20 or larger in the matrix. АП о! 
паб lations of variable 26 (M) with the 65 
04 па teaching success are negative. ча 
thes nine correlations of variable 28 (0) with — 
нозе estimates are negative. АП nine correla 
re „Of Variable 31 (Qs) with these estimates 
la энийг with seven of them being 20 о 
( T. Six of the nine correlations of varia 
аг 35 n the nine teaching success estimates 
itive о ат ine corre 
iem The 4 correlations of "p xr 17 
tea’, 19 (C), 21 (Е), 25 (L), and 30 (За 
Aj Bing е ыа irae are all less than .20. 


the co i d to be quite small 
ere rrelations ten lationship 
b ore, little relatio" 
е there seems to be ates of teaching 


een + : : 
Suc hese particular estim: - 
с : son 
855 and the sixteen source traits of per 
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ality (as assessed by the 16 Р.Е. Test). 

The Ry Matrix was post-mu:tiplied by Ше E 
Matrix to yield the Gy Matrix (Table ХҮП). The 
matrix multiplication GyH-1G' yielded а repro- 
duced correlation matrix of order sixteen by 
nine labeled Кў. The matrix subtraction Ry - 
В+ yielded the matrix of residual correlations 
( y^ ЕЈ). (See Table ХУШ.) These residuals 
tend to be quite small. It thus appears that the 
factoring method employed accounts for these 
correlations. Therefore one might conclude 
that the three oblique factors also undeilie the 
sixteen personality source trait variables. The 
correlations of the personality variables with 
these oblique factors may be found in Table XIX. 
This sixteen by three structure matrix was ob- 
tained by the matrix multiplication GyW - Sy. 
The pattern matrix Py Was obtained by the ma- 
trix multiplication 5уф“ 1. This matrix will be 
found in Table XX and lists the coordinates of 
the sixteen personality variables with respect 
to the three oblique factors. These coordinates 
as pointed out earlier in this section are also 
called the factor loadings. 

The structure matrix Sy reveals that the сог- 
relations of the sixteen personality variables 
with the three oblique factors are low. Of these 
sixteen variables only variables 22 and 31 are 
positively correlated with each oblique axis. 

Ап examination of Table XX indicates that 
variables 18 and 29 have significant loadings on 
Factor I. On Factor II will be found significant 
loadings for ten of the sixteen personality meas- 
ures. The variables having significant loadings 
are 17, 18, 20, 23, 24, 27, 28, 29, 31, and 32. 
variables 20, 22, 23, 24, 26, and 29 have sig- 


nificant loadings on Factor Ш. 


Part Four: The Factor Analysis of the Rz 
Matrix 


The correlations of each of the ten achieve- 
riables with each of the nine estimates 
ccess were calculated and record- 
ed in the ten by nine Rz Matrix (Table ХХ1). 
Thirty of these ninety correlations are neg- 
ative. It is interesting to note that all nine cor- 
relations of variable 33 (PT75) with the nine es- 
timates are positive with four of them being 
significant at the 5% level of significance. Like- 
wise all of the correlations of variable 34 (Prac- 
tice Teaching Grade in Educational Methods 
Course) with these nine estimates of success, 
although small, are positive. These correla- 
tions range from -.29 (М = 52, between vari- 
abie 35, Grade in Education 73, and pupil eval- 
uation, variable 9) to .28 (N = 62, between var- 
iable 33, РТ75, and variable 2, PM1). Onlyten 
of the correlations are . 20 or larger, Eight of 
the nine correlations of variable 36 with these 


ment va 
of teaching su 


_ estimates of teaching success are negative 
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TABLE ХУП 
CORRELATIONS OF EACH PERSONALITY VARIABLE WITH 
EACH GROUP 
Gy MATRIX 
I п ш 
17 02* 29 -01 
18 -13 40 29 
19 -06 -07 -03 
20 -08 19 -15 
21 19 -03 -21 
22 65 50 48 
23 23 54 -07 
24 -08 = -40 
25 -32 -03 00 
26 -71 -39 E 
27 -31 53 34 
28 -41 -66 -09 
29 -59 09 -43 
30 -09 -13 -10 
31 "7 87 20 
32 -65 -48 02 
*Decimal points omitted 
TABLE XVIII 
RESIDUAL CORRELATIONS 
Ry-Ry MATRIX 
5 Ч Е 
su E 3 B 0205 2 
19 m -03 m 07 00 -02 03 10 Am 
E 03 -03 -01 E K. ра o 10 10 
21 = 0 ёс 10 -02 08 -07 00 E. 
23 Ёо ў 06 -15 09 Е 
m - 14 09 04 04 
23 m ES Г 05 -08 20 -12 05 k- 
24 2 10 dui -05 -11 00 11 01 E 
2 a Е. i к 05 -01 -04 48 
5 02 -02 07 07 05 
26 -04 00 -12 06 06 03 -02 
27 10 =06 0 08 -06 06 00 та | 
2 и E р Е 15 -04 -11 -0Y 
5 - 08 07 о: 
2 ЈА 00 i г16 02 15 н 
5 - 05 06 6 -06 
30 03 06 217 -07 05 02 m 2) 
02 04 сн -07 -10 18 
+ 04 00 -07 03 or 18 is 04 244 
5 00 -03 12 УУ 07 


“Бап 
Decimal points omitted 
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TABLE XIX 


CORRELATIONS OF EACH PERSONALITY VARIABLE WITH 
EACH OBLIQUE FACTOR 


Sy MATRIX (STRUCTURE MATRIX) 


I п ш 
17 006* 143 -053 
18 -226 197 218 
19 -019 -034 -023 
20 -025 093 -113 
21 059 -015 -158 
22 201 246 361 
23 071 266 -053 
24 -025 -054 -301 
E -099 -015 000 
Р -220 -192 -383 
28 -096 261 256 
-127 -325 -068 

29 -182 Е 
30 044 323 

-028 4 5 
31 064 075 
238 428 150 

32 -201 
-236 0 


15 
*Decimal points omitted 


Py MATRIX (PATTERN MATRIX) 
17 ; = = 
Л “ar 393 -284 
i D 365 049 
50 е -030 -003 
d a 387 -336 
22 15 123 -243 
23 а -098 394 
24 -00 617 -424 
25 и 300 -479 
26 “269 055 -015 
27 -276 268 -512 
28 боз 344 079 
29 Е ы 265 
] Л Е. E: 
1 : = 060 
059 -381 P 


A 
Decimal points Omitted = 
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TABLE XXI 


CORRELATIONS OF TEN PRE-SERVICE MEASURES OF ACHIEVEMENT WITH NINE 
ESTIMATES OF TEACHING SUCCESS | 


Rz MATRIX 

1 2 3 4 5 6 7 . 8 9 
88 08* 28 25 17 11 24 28 28 12 
(64)** (61) (62) (58) (63) (60) (62) (56) (53) 

ka 05 06 13 19 03 08 07 19 10 
(64) (61) (62) (58) (63) (60) (62) (56) (53) 

35 09 -16 06 00 00 -09 09 -01 -29 
(63) (60) (61) (57) (62) (59) (61) (55) (52) 

38 -02 -03 -03 -10 07 -07 -04 -10 aia 
(63) (60) (61) (57) (62) (59) (61) (55) (53) 

a 1 00 03 i -04 12 06 "m 
(64) (81) (62) (58) (63) (60) (62) (56) (53) 

38 = Р 14 -17 -01 -06 -10 -11 
бо — 6) S d б ® е 09 

39 Р Е 06 -23 10 04 -09 -07 
m м 3 б б м б d» 08 

40 Е -08 00 18 10 10 -19 
ви в M = в = = ш 
41 -02 10 24 06 13 22, 
(64) (8 6%) (58) (63) (60) (62) (56) (53) 

42 18 09 06 15 04 
и s бб ем 89 64 


(64) (61) 
of the subgroup used to calculate the correlation. 


* 
Decim: ry - 

al points omitted. š 
ыг —" ze 
Number inside parenthesis indicates the 51 


27 


28 


The Educational Methods Composite Lecture 
Section Grade, Variable 42, correlates posi- 
tively but low with these nine variables. 

The Rz Matrix was post-multiplied by the E . 
Matrix to yield the Gz Matrix (Table XXII). The 
ten by nine reprodvced correlation matrix RZ 
was obtained by the matrix multiplication 
GzH-1lG', This reproduced matrix was subtract- 
ей from Rz to produce the Rz - RZ matrix of 
residual correlations. 
in Table XXIII. Since t 
Small one must concludi 
Solution applied to his 


The pattern ma- 
€ XV was obtained by the 


Sz0-1 = ри. These values 
give the Coordinates o 


; 21, and 42 аге positively cor- 
related with each axis, 


None of these ten variables have Significant 
loadings on Factor I (refer to the Pz matr ix). 
Variables 35, 36, and 40 have small but signif- 
icant loadings on Factor II and оп Factor III sig- 


nificant loadings for variables 34, 35, 36, and 
40 will be found. 


Part Five: The Factor Estimates 


In the first four art, i 
been concerne uu Ot thi 


dw 
resolution of the 


rial i 
hypothetica] factors, ща Rt 2. m 
techniques Will be em 
three obliqui 
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presented by Holzinger and Harman. | 
In standard form the equations are: 


= 28124 + 
1) Е 7.3122; + .27229 + .19223 +. zd 
id 04275 + .04226 - . 01827 - .00828 

· 00829 


= 524+ 
(2) Ер =.12721 + . 04923 - . 01523 етм 
· 40725 + .30326 +. 15927 +. 
. 04729 


(3) Е. = . 00021 + 
ш - 05225 + 
š 39629 


+ 
11922 - . 08123 - ая 
. 17326 + .10827 +. 


rm 
An estimated factor is not in standard 10 and 
although such a variable has a mean of са: P 
а standard deviation equal to the coeffic 
multiple correlation, 2 ion for 
The coefficients of multiple correlatio 
these factors were as follows: 


S.D. I = Вр =.946 
S.D. П = п =.896 
5.0. Ш = врт = „881 


іп 
sed} 
The estimation equations when expres 


terms of the Observed values are: 
_ 6x4 * 
(Fy = «390хү + 313х + .229x3 + Eu Я 
“0675 +. 023х6 - .027х7 -. 
“003х9 - 3. 01 
_ 6х4 + 
(5) Ри =. 159х) + .056хо - .018x3 - . 02 


6х8 + 
А 646х5 *.163xg + .241х7 +. п 
- 016хо - 4. 14 


(6) Fn = - 000х1 + · 137 хо - .096х3 - boc 
:083x5 + . 093х6 + .164хт+. 
-131х0 - 3.48 
а 
Each of the above equations was evaluate » 
for each teacher. The factor scores аге 5 
in Table xxv. tran? 
In order to eliminate negative values 4 as 
formation to ап arbitrary positive scale У 


2 таде Я 

и е factors жы to describe these The factor ores Were standardized шше 5 
vice estimates Of teachi ms of the nine inser- Variable was €quated to an arbitrary vari?" gpi 
ing of each Variable in ng Success. The weight- with mean of 5 and sta: tion of 
fice determi a party Ч š p. emen equa- transformation "em p “.. 
(structure value) ог iable wine Ation | 

n apt ва е =. € with the factor (7) Хи =F 

меге determineg by ц $ 


25. Ор, Cite, рр, 278-83. 


= В RF, ВР. 
26. Ibid, р, 273. шы 


Si = Е + 5 


— 
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TABLE XXII 


CORRELATIONS OF EACH ACHIEVEMENT VARIABLE 
WITH EACH GROUP 


Gz MATRIX > 


I п ш 
33 78* 63 40 
34 43 18 29 
35 -01 00 -36 
36 -18 -04 -30 
37 27 20 -08 
38 09 -24 -27 
39 -14 -09 -16 
40 -01 28 -09 
41 26 40 35 
42 34 33 19 


*Decimal points omitted 


TABLE XXIII 
RESIDUAL CORRELATIONS 
Rg-Rz MATRIX 

с 2 
1 2 3 4 5 6 7 8 Е 
33 5 00 -12 -01 13 06 “08 
ss “08 08 05 09 -02 -01 02 05 s 
à 08 :18 04 -01 -05 -07 12 08 aa 
98 02 Эн -01 -06 05 -03 -02 и i 
A a -07 -04 02 -11 09 08 m 
e -08 Еу 02 10 -10 08 03 04 ba 
39 08 -04 E io л og X E о 
_ и Ti -08 -07 Е 10 03 11 -11 
41 04 11 ын 207 -03 09 -08 -05 a 
и 03 07 01 04 ДЕ эм 0 04 -04 


* 5 
Decimal points omitted 
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TABLE XXIV 


CORRELATIONS OF EACH ACHIEVEMENT VARIABLE WITH 
EACH OBLIQUE FACTOR 


Sz MATRIX (STRUCTURE MATRIX) 


I II ш 
33 241* 310 301 
34 133 089 218 
35 -003 000 -271 
36 -056 -020 -226 
37 084 098 -060 
38 028 -118 -203 
39 -043 -044 -120 
Fi -003 138 -068 
22 e 197 263 


162 


143 
*Decimal points omitted 


COORDINATES ОР БАСН ACHI 

EVEMENT VARIABLE 

RESPECT TO EACH OBLIQUE FACTOR "11H 
Pz MATRIX (PATTER 


N MATRIX) 
ee 
34 ur 093 215 
35 Aut -206 321 
36 -140 364 -489 
37 006 306 -400 
38 072 229 -209 
39 -063 -026 -198 
40 m 098 -173 
41 027 410 -307 
42 050 030 


240 
087 079 
*Deci n 
‘mal points omitted 
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TABLE XXVI 


THE THREE OBLIQUE FACTORS EXPRESSED IN 


TERMS OF OBSERVED VALUES 


ESTIMATES OF 


I 


5 


Teacher 
Number 


Еш 


Телспег 
Number 


32 


The transformed factor scores аге Shown in 
Table XXVII. A low number indicates a high 
"composite" rating. 

We will consider that а score of 6 or larger 
(1 S.D. or more above the mean) indicates that 
а teacher tends to be considered a poor teacher; 
and that a score of 4 or less (1S. D. or more be- 
low the mean) indicates that a teacher tends to be 
considered a good teacher. 

Using these standards we find that teachers 
numbered 1, 16, and 32 would be considered be- 
low average since for each of these teachers the 
three factor scores were greater than six, Tea- 

^ chers 25 and 53 had factor scores of 4 or less 


They would be consid- 
ered as above average as teachers, 


e two mentioned, 


Бе as regards fac- 
ers have factor 


; and seven te. 


i find that there 
are eight “good” and seven “роог” teachers аз 


determined by “composite” one, 
: Теп “good” and eleven “poor” teachers are 
identified by “composite”? two. 

Ша similar fashion nine « 


“poor”? teachers are identifie 


good” and eleven 
three, 


Ч by “composite” 


Par 


t Six: The Prediction Study 


: dered аз « ite" eri 
ia of teaching Success, шыны ам 
Тће Correlations of e i 
t ach 
42) with each of the three В, n a 


mposite criteri 
le Ххуш. шы 


lumn of the Sx, Sy, 
Crepancies between the 
and the Structure 
for factors Ц d and та matrices are lar er 
E мн due to Ше linear == ын 
ш EU. 5) employed (0 obtain esti- 
^tors, Ч 
of correlation for factor I s anle coefficient 
for either factor IL or mr, апа therefore mene R 
е two 


· The di 
correlations of Table = 


values in the S 
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Sets of correlations related to factor I d 
Show the greatest agreement. A correla 5. 
-25 or larger was required to indicate pe 
calsignificance. Using such a шш) 5167 
Íound that none of the variables correlate que 
nificantly with “composite” criterion one. гге!- 
iables 28, 31, and 33 were significantly Ч 21; 
ated with criterion two; while variables 2 =e 
and 33 were significantly correlated with C 
terion three. I" 
A multiple-correlation coefficient for isi" 
ables 28, 31, and 33 with “composite” criter 
ion two was computed. R was found to be rea 
The intercorrelations were as follows: ipt 
able 28 correlated -. 48 with variable 31, ted 
-07 with variable 33. Variable 31 correla 
. 09 with variable 33. ре 
А multiple-correlation coefficient for eo 
ables 26, 27, and 33 with “composite ви A 
ion three was also computed. R was founi were 
be .42. The intercorrelations in this yor and 
found to be 26,27 = -.26; гоб 33 = — ~ 
г = ‚19. t- 
E i1 of the very low multiple R’s ^ 
ед above it appears that the prediction О tem^ 
factor scores obtained in this study USE дар 
perament, personality, and pre-service ка 
Чгев of achievement is not promising. та of 
multiple R's reported account for only 1 Ян 
the total variance of “composite” criteri 
and three, исап" 
Since none of the measures were signifi Ес 
ly related to "composite" criterion one, ti- 
tempt was made to predict this derived е5 
mate of teaching Success. iction 
One must conclude that accurate gua us" 
О1 the three obtained “сошровие”” етпе гуй 
ing the measures and the techniques етр 
in this study is not possible, or sensible, this 
The results of each of the six parts 0 of 
Section have been summarized at the end si 
each part. The final summary and conclu 
Will be found in the next section. 


0п5 


SECTION IV 


SUMMARY AND CONCLUSIONS 


Statement of the Problem 
о: the Problem 


as 
THE PURPOSE of this investigation „ср 
to develop equations for the prediction of ri^ 
Ше success with а minimum number of V4 y 
ables and maximum Stability as suggeste the 
factor analyses оға variety of measures pe^ of , 
temperament, Personality, and асһіеуете! ар 
teachers, Order to develop a basis for 24У 
lified patterns О prediction a factorial $ 477 
Was made of the interrelationships among 


еті 
jn 
Several variables. These factors should Р? 
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TABLE XXVII 


TRANSFORMED FACTOR SCORES 


Teacher +. +. Teacher т яа 
Number ү П Еш Number 5 Еп 
1 7.21 6. 50* 6. 00* 33 4.24 5.07 
2 5. 78 4. 10 4. 69 34 4. 64 3. 95** 
3 4.64 4.42 4.57 35 5.99 6. 19* 
4 3.20** 3.92** 5.70 36 5.87 4. 94 
5 4. 63 4. 93 5.35 37 4. 82 5. 00 
6 6. 49% 4. 00** 3. 41** 38 5.35 5.29 
7 4.85 5. 10 5.05 39 4.20 4.52 
8 6,325 5.56 4. 69 40 5. 68 5. 41 
9 4.59 4. 85 4. 81 41 5. 64 5. 62 
10 SLOTTE 4. 03 4.47 42 4.24 3. 1355 
41 5. 13 4. 35 4.17 43 5.19 4.96 
12 5.02 5.59 5.12 44 5.04 6.23* 
13 5.48 4. 14 3. 41** 45 4.76 4.80 
14 4.34 5.29 6.30* 46 6. 19* 5. 18 
15 4. 19 8.88** 4.63 41 3. 74** 4.24 
16 8. 60* 7. 08* 6. 05* 48 5.91 4. 89 
17 5. 79 5. 83 5. 82 49 4. 06 3. 08** 
18 4. 94 4. 53 4.36 50 4. 40 5.88 
19 4.25 5.51 6. 09* 51 5. 15 5.30 
20 5.61 6. 34* 5.35 52 4. 40 3. 77** 
21 5.94 4.97 4,76 53 3.83** 3. 86** 
22 5.44 4.81 6.34* 54 4.34 4.56 
23 5.88 4.24 9; T1 55 4. 63 5. 09 
24 4. 40 6. 14* 6. 44* 56 4.97 6.31* 
25 9, 25'** 2.95** 3,85"" 57 3. 93** 5.21 
26 5.36 4.29 4. 46 58 5.20 5. 08 
27 4.86 6. 73% 5.11 59 4.58 4.19 
28 4,12 4.36 4.11 60 9. 78** 4.17 
29 6.33* 6. 09% 5.51 61 5.12 6. 71* 
30 3.83%% 3.97** 4.23 62 4.56 5. 09 
31 4.10 4. 46 5. 07 63 5.21 5.95 
32 6.36* 6. 53* 6. 42* 64 5. 68 5. 95 


2 
H 


Фф л єл > t= ре л л бл л {л S2 S2 ёл {л оо н> фе ү ре @ а ТО бл = G> л л лл со сл 


* 15 р. or more above Ше mean. 
**1 S.D. ог more below the mean. 


33 


34 


JOURNAL ОҒ EXPERIMENTAL EDUCATION 


TABLE XXVIII 


CORRELATIONS OF VARIAB 


LES TEN THROUGH FORTY-TWO WITH THE 
"COMPOSITES": 


CRITERIA (FACTOR ESTIMATES) 


Variable Е БЭ = 


Variable - = Е 
Number Ё Fy Еш Number ЁТ Еп ш 
0 = -03 18 27  -08 16 25** 
п о 15 17 28 -14 -25** -15 
12 09 14 01 29 -17 -07 =4Б 
n ^1 18 05 30-04 -05 -04 
14 15 15 08 31 23 35** 21 
15 24 17 -02 32 К 2% 38 
16 07 03 -04 33 29 ОБЖ 28** 
17 01 07 -01 54 Л =“ 18 
18 -20 11 19 35 00 404 -19 
19 -01 -02 -03 36 -05 -02 -12 
а - E. 00 37 од 06 -05 
21 06 -02 271 38 01 „19 -16 
22 18 22 23 s Es к. ы 
23 10 23 09 ын сн 3 id 
24 -03 -09 -21 5 8 n 2 
25 -09 -02 -01 42 m 
26 -21 


17 07 
-23 -28** 

* Decima] points omitted 

**Significant at the 5% level 
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the way to better estimates of teaching success. 


Measures Used in the Analysis 


Forty-two variables were used in the analysis. 
These may be classified into four groups as fol- 
lows: 

Group (a). Nine estimates of teaching success, 
consisting of: 

1. The principal's acceptability rating of the 

teacher 

2. The principal's rating of the teacher (1st 

year) on the Wisconsin Adaptation of the 
M-blank 

3,4. A supervisor's rating of the teacher on 

the Wisconsin Adaptation of the M-blank 

5. The principal's M-blank rating of the tea- 

cher (2nd year) 

- Teacher ratings obtained from an outside 
agency 

- Teacher's self-evaluations 

. Peer evaluations 

. Pupil evaluations 


c 


ср со = 


Group (b) Measures of temperament. This 
Егошр was composed of seven variables derived 
from the Thurstone Temperament Schedule. They 
Were as follows: 

10. Active 

11. Vigorous 

12. Impulsive 

13. Dominant 

14. Stable (E for emotionally stable) 

15. Sociable 

16. Reflective 


Group (c). Measures of personality. This group 
Was composed of the sixteen variables obtained 
Írom the Sixteen Personality Factor Test. They 
Were as follows: 
17. Cyclothymia vs. Schizothymia 
18. General intelligence vs. mental defect 
19. Emotional stability or ego strength vs. 
general neuroticism | 
20. Dominance ог ascendance vs. submission 
21. Surgency vs. desurgency 
22. Positive character vs. immature depend- 
ent character 
23. Adventurous cyclothymia vs. inherent 
withdrawn schizothymia : 
24. Emotional sensitivity vs. tough maturity 
25. Paranoid schizothymia vs. trustful acces" 
sibility 
26. Bohemianism vs. prac 
ness " 
21. Sophistication vs. rough simplicity _ 
28. Worrying suspiciousness vs. calm trust 
fulness 
29. Radicalism vs. conservatism 
30. Independent self-sufficiency VS- lack of 


tical сопсегпед- 
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resolution : 
31. Will control and character stability 
32. Nervous tension я 


Group (d). Measures of pre-service achieve- 
ment. These measures were obtained from 
University files and were as fóllows: 
33, 34. Practice teaching grades in Educa- 
tion 75 and education methods course 
35, 36, 37. Grades in Education 13, 74 and 
lecture section in Education 75, respec- 
tively © 
38. Percentile rank in high school class 
39. Percentile rank on American Council 
on Education Psychological Examination. 
40. Freshman-sophomore grade point aver- 
age 
41. Junior-senior grade point average 
42. Composite grade for two education 
methods courses 


Design of the Stud я 


Sixty-four teachers engaged in their second 
year of teaching in Wisconsin high schools were 
chosen for this study. This group of teachers 
had graduated from the School of Education of 
the University of Wisconsin in 1950. They were 
a subgroup of the total group of 101 (1950) grad- 
uates visited during the beginning teacher visi- - 
tation program in Ше fall of 1950. The first 
four estimates of teaching success were ob- 
tained during this visitation while the remain- 
ing five estimates were secured during the 
1951-1952 school year. 

All ratings and grades were converted to 
numerical scores for the analysis. The Pear- 
son product-moment coefficient of correlation 
was used throughout the study to indicate linear 
relationships between various sets of scores. 

The matrix of intercorrelations of the teach- 
ing success estimates was factored using the 
multiple-group method of factoring. А further 
study was made to determine if such factors 
were factors underlying measures of tempera- 
ment, personality, and achievement. Estimates 
of these factors were used as **composite"' cri- 
teria of teaching success in the prediction phase 
of this study. 


Results of the Statistical Analysis 


The questions originally asked in Section I 
will be answered here. А general factor does 
not account for the intercorrelations of the nine 
estimates of teaching success. Thethree oblique 
common factors which accounted for these in- 
tercorrelations may be designated as: 


1. Beginning Teacher Rating'Scale Factor: 
Principal’s acceptability rating, Princi- 


36 


pal's M-blank rating (1st year), Supervis- 
or I M-blank rating, and Supervisor II M- 
Байк rating 


IL Second-year Rating Scale Factor: Princi- 
pal's M-blank rating (2nd year), Outside 


agency rating, and Teacher's self-evalu- 
ation 


ш. Peer-Pupil Response Factor: Peer eval- 
uation, and pupil evaluation 


These factors were found to underlie the sev- 
eral temperament, personality, and achievement 
udy. The residual сог- 
ectangular matrices 
refore further factoring did 

Additional factors m ight 


matec of teaching suc 


Factor estimates of the three factors used as 
"composite Criteri: 


а would identity eight “good 
and seven “poor” teachers (factor 1; ten “good” 
and eleven ‹‹ 5 і 


temperament, perso 


Only nineteen of these ninety-nine Correlations 
were .20 or larger, Correlations of these three 
types of personal data with the nine original ез- 
timates of teaching Success were also generally 
low ranging from - 


- 32 to .38, Fifty-four of 
these 297 Correlations were -20 ог % 


rger. 
Conclusions 
<- 1191018 
The low Correlations of the 
Эв - | Several tempera- 


Өз scales of the 16 p 
) ч : F. Test i 
tice teaching Бгаде in ducatio, oe : 
the twelve Correlations ; эй а 
ism VS. practica Conc 
while the thirty-six сое 
(positive Character у 
°. - imm: 
character), Әз (will Control ша 


‘Pendent 
bility), and Practice teaching a 


Character sta- 
Те positive, Due 
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T е" 
to Ше consistency of these correlations, Moe, 
gards sign and magnitude, it would а 56 
these four measures are slightly relate 
teaching success. r the 
Since а general factor did not ae a 
intercorrelations of the estimates of tea. Vera 
Success, one must conclude that opi ” 
ratings are not measuring the Same 19 ed by 
Therefore, the use of a criterion abami ђе just” 
averaging these nine measures would пс of tea- 
ified. The three derived “composites in a pro" 
ching success could be used separately 
gram of differential prediction. 
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А STUDY OF CERTAIN CRITERIA OF T EACH- 
ING EFFECTIVENESS `, 


HAROLD MILTON ANDERSON 
University of Colorado 


Boulder, Colorado 


SECTION I 


THE PROBLEM 


Gene 1915 BOYCE (14) pointed out the need 
hess jective measures of teaching effective" 
e He stated that this need is expressed in 
eri omi, namely: (1) in the guidance of pro- 
Os tms teachers; (2) in the improvement of 
dismi rs in service; and (3) in promotion and 
(eters Boyce was concerned with the eval- 
area + teacher efficiency. As theworkinthis 
Over ha extended, increased concern аг ose 
на. criteria of teaching effectiveness. Eight- 
years later G. L. Betts (10:99) stated: 


NU. of the crucial problems in evalu- 
iode the education of teachers, if not 
emn the crucial problem, is the dis- 
нары, of a satisfactory criterion of | 
at | ing success. With such a criterion 
to hand, it would be possible immediately 
NES à scientific evaluation of the 
Servi of various programs for the pr €- 
Bins education of teachers through à 
em y of the teaching efficiency of large 
ime ih teachers prepared in accord- 
ПЕРА with those programs. It would be 
еще to determine what knowledges, 
ass S, and attitudes are most commonly 
to i with good teaching, and thus 
пена n curricula definitely directed to- 
It wo increasing these desirable assets. 
вани be possible to discover what ca- 
good d andpersonaltraits are typical of 
missi еасһегв, and thus to select for ad- 
of te ion to institutions for the education 
АЕ the candidates most likely to 
още me successful teachers. Scores of 
as d problems relative to such matters 
ion “ке, salary, methods of superviS~ 
mu value of practice teaching, аве 
cati ications, requirements for certifi- 
рег? апа {һе Пке, сош4 Бе studied ех 
and ЯЦА In the absence of а vali 
сев reliable criterion for teaching suc- 
e S, solutions for these urgent prob- 
ms must be sought in the realm of ex- 


As late as 1949 Ryans (58:696) wrote: 


Certainly until we are able to establish 
adequate criteria of teaching competency, 
our whole system of teacher training, ap- 
pointment, promotion, and tenure funda- 
mentally is on shaky ground. 


A multitude of attempts to establish a satis- 
factory criterion have been made during recent 
years. The criteria that are in general use at 
present may bé divided in three categories: (1) 
merit ratings; (2) measures of pupil status and 
change; and (3) tests of abilities thought essen- 
tial to success. Rating scales may be further 
classified with respect to the person using the 
scale, namely the supervisor, administrator, 
pupil, teaching colleague, or the teacher him- 
self, Pupil status and change is measured by 
some form of test which is designed to estimate 
the extent to which certain objectives of instruc- 
tion are attained. In some cases these tests 
cover only certain selected aspects of subject 
matter, but often they attempt to discover status 
and change in areas such as attitudes, interests, 
appreciations and information. Evaluations of 
this type are sometimes made for a single school, 
city, county, ог even an entire state. ‘‘eacner 
examinations usually measure professional and 
subject matter information, mental capacities, 
cultural status and professional interests and 


activities. 
This study is concerned with the degree to 


which the various criteria of type 1 and 2 agree 
in their rankings of teachers. 


Statement of the Problem 


The primary purpose of the study reported 
herein is to investigate the relationships among 
certain criteria of teacher effectiveness by the 
use of comparative and correlational techniques 
A secondary aim is to trace the historical de- у 
velopment of these criteria and to note justifi- 
cations offered for their use. Тһе investiga- 
tion also ае а followup of selected teach- 
ers holdi e Universit 4 5 
er's ен сива. У of Wisconsin Teach- 

It should be born in mind that this is not an 


Pert Opinion, 


* The 
соу Süthor wishes to express hi: 


Our, А 
agement, direction, and ins 
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attempt to validate criteria of teaching compe- 
tence. Such validation implies that a known 
Standard exists and that comparisons can be 
made to discover the extent to which the partic- 
ular criterion correlates with the standards. In 
this study no such standard is accepted or post- 
ulated. ` 

Specifically the investigation seeks to answer 
the following questions: 


1. What justifications are commonly offered 
for the иғе of various criteria? 

2. To what extent are these criteria correl- 
ated? 

3. To what extent do the different estimates 
made by the use of the same instrument on the 
Same group of teachers by different raters agree? 


SECTION II 


AN OVERVIEW OF THE CRITERIA SELECTED 
FOR STUDY 


THE EDUCATIONAL literature is filled 
with materials relative to the criteria of teach- 
er effectiveness. Some of the material is based 
on research; some on philosophic principles and 
logic; and some primarily on opinion, often 
founded on casual observation and intuition. The 
reader needs to exercise considerable judgment 
and discretion in picking his way through the rel- 
evant and irrelevant. 

The following discussion represents the ma- 
terialthat the writer felt significant in сопвіс- 
ering the strengths and weaknesses of the select- 
ed criteria. The organizational plan takes up 
first rating system in general, then proceeds to 
Specific rating categories designated by the clas- 
sification of the rater, continues witha bri ef 
consideration of teacher evaluation by pupil 
achievement, and Concludes with a brief sum- 
mary. 


: E the criteria of teaching effectiveness are 
8 : 


cerned about the problem 
Pittenger (50) states that loo: 
оріс; 
їһгее Бавев for estimating Pee nidis А 
ability. It is possible to judge effectiveness by 


1 


(Vol. ХХШ | 


the results produced, by the processes employed 

in teaching, or by the equipment that the Кр | 
ег possesses for teaching. Тһе last two пеш, | 
will be considered along with rating scales whil 

the first will be considered with pupil achieve 

ment. 


Rating Scales as Criteria 


It seems inevitable that teachers willbe ши 
uated with or without the aid of a measuring ts 
vice or instrument. И such evaluations сап ib 
made to agree with the judgments of society ын 
а higher degree of consistency through the pen 
of some instrument, then the use of such a 
is valid for that purpose. A number of ram 
scales have been developed with that objectiv 
in mind. А сей 

The rating scales that have been widely шин 
in the field of teacher evaluation may be вер air 
ated into two broad categories: (1) general Tapa 
ings which are all-inclusive regarding the m 
it of the teacher; and (2) specialized scales sg 
which consider traits and qualities or note p 
ific behaviors which are believed to reflect 
teaching ability of the teacher. | is that 

The first of these types is criticized in may 
it is a subjective personal evaluation hero m 
fail to give proper consideration and weigh es ве 
to all the important factors contributing to te is 
ing success or failure. A rating or ae 
given which states the position held by the га? 
cher with reference to other teachers a c c 0 
ingto the standards of the rater. ect 

The second is often criticized with resp fac" 
to the method of selecting and weighting the ын 
tors used. Experts in the field often аіѕавг аг 
as to which traits, behaviors, and qualities to 
essential to teaching success and the exten! ‘pye 
which each contributes. Such a scale does ээ 
to emphasize those traits, qualities and ре das 
iors which the scale producers have selecte e 
the attributes of good teaching. When а SC? i 
of this type is used with a number of patera 
may be considered as the definition of a e: 
teacher. A number of subjective judgmeni hen“ 
have been substituted for the grand compre, 
Sive evaluation of the first type. There 1 ng 
strong tendency for the rater who hasa Qo 
conviction regarding the overall merit of of the 
ratee to rate him accordingly on all items 10 
point scale. This tendency is knownas the 
effect. ” uctio” 

The semantic problems in scale constr E tend 
аге great. The use of poorly defined {ей e 
10 гедисе Ше inter-rater objectivity of та ег” 
scales. The words employed often have. ity 
ent meanings for different raters. ambien’ 5 
must be avoided. Detailed definitions of ter, 
and personal conferences among raters mié ! 
be very helpful in this respect. | 
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us of the outstanding weaknesses of rating 
Баси procedures is Ше tendency of the rater to 
МА -rate the ratee. An excellent example of 
of 837 the іп-вегуісе follow-up by Goetsch (28) 
Moi lowa State Teachers College graduates by 
eiie 5 a rating scale incorporating 20 сһаг- 
rated a ics. He found that the teachers were 
age ley follows: superior, 30 percent; aver- 
below percent; above average, 52 percent;and 
s права ЖӨНЕП, While the writer has 
tion i e highest regard for the training institu- 
only иам, he does seriously question that 
Kni енед percent are only average ог less. 
нэг (40), in studying this tendency to over- 
aeq found that it increased with the length of 
or ee of rater and ratee. Perhaps the 
lies А. xplanation of the tendency to over-rate 
standa the fact that raters substitute their own 
rds for those employed in the rating de- 


Vice, : 
aptly: Symonds (60:693) expresses this very 


Ness supervisor has his own ехрес” 
aes m and unique requirements in а 
mph ... ЛЕ will never be possible 
19 ind agreement in teacher rating ав 
ань аз principals and supervisors һауе 
erent standards for judging teachers. 


шини emphasizes the fact that ratings should 
spent de only after considerable time has been 
in the a observation, The impression obtained 
е irst few minutes may be deceiving in that 
tap, ee containing an observer is not the 
iff al habitat of the student and his reactions 
er accordingly. 

о пи bitterest attacks on rating scales pertain 
e < lack of reliability in these instruments. 
ав x mations in results that occur may со me 
in tho sequence of change inthe teacher, change 
Scale observer, or in the interpretation of the 
length Ratings are certainly affected by the А 
Of рег апа conditions of observation, the attitu es 
String г involved, the social and emotional | 
ver of the pupils, the prejudices of the obser 

» апа the nature of the occasion when the last 


rati 1758 
the sÉ took place. It is not at ап скрие Бе 
їп Ше 


оа statement by 


R : 1 
иь ОТ) that the reliability of a rating Varie? 


ing to 
It qi conside e intereste 
t r for thos Tad conditions i 


€ article, 


Schultz (59) warns that effectiveness can not 
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be accurately estimated by 4 summation of rat- 
ing which is essentially the same as the ауег- 
aging process. He makes a point of stressing 
the fact that evaluative processes should in- 
clude the person being rated and should be for 
the purpose of improving teaching. 

In spite of the deficiencies of rating scales, 
they continue to be used. One needs to remem- 
ber, as Hansen (33) points out, that teachers 
are often hired or fired on the basis of subjec- 
tive information only. The practical world 
insists that decisions be made. Certa:nly a 
valid evaluation might be exceedingly helpful 
for the guidance, protection, and improvement 
of teachers. 

Baier (3), in discussing officer rating 5у5- 
tems states: “In some cases ratings may be 
the best criteria because value judgments are 
essential elements. '' The same may be true 
of teacher evaluation. 


Specific es of Ratings 


Teacher ratings may be made by the teach- 
er himself, by supervisors, by pupils, by peers, 
and others. Perhaps the most frequent type of 
rating is that by the supervisor. One of the out- 
standing advantages of this type of rating is that 
a number of teachers within the system may be 
ranked in order of excellence according to the , 
supervisor's standard. Inasmuch as the super- 
visor has the opportunity to observe the teach- 
er on more than one occasion, the probability 
of that judgment being made on an unusual per- 
formance is very slight. Since supervisors are 
expected to diagnose difficulties and aid teach- 

t of their duties, they may be expect- 


ers аз par € / 
ed in general to be well qualified to judge teach- 


ing competence. At the times when ratings 
must be obtained for areas greater than that 
served by a single supervisor, the ratings are 
subject to additional error arising from differ- 
ences in raters. 
Teachers have also been evaluated by stud- 
ents. The basic assumption is that because of 
his close contact with the teacher the pupil has 
information not possessed by others for render- 
ing sound judgments about the effectiveness and 
ability of the teacher. The use of such rating 
is questioned by many, however, who argue that 
pupils lack the maturity to judge competently. 
Lack of experience with teachers in any quant- 
ity prevents the differentiation of superior and 
mediocre teachers on the lower grade levels. 
It is often further argued that they lack the ex- 
perience and maturity to pass judgment on the 
value of the course contents. Nonetheless 
Cook and Leeds (21), and Albert (2) state that 
pupil evaluation of teaching is reliable, valid 
and practical. Bryan (18) urges the use of pu- 
pil evaluation because: (1) the learner’s atti- 
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tude is significant in the learning situation; (2) 
ratings emphasize the need of improvement; (3) 
an increase in concern over teaching problems 
by the staff; (4) pupil ratings are an index of е!- 
fectiveness because teacher influence is propor- 
tional to the respect and admiration of pupil for 
instructor; and (5) trains pupils to be critical 
citizens in a democracy. Boyce and Bryan (15) 
found that pupil opinions tended to be quite stable 
over a five-year period. Some universities (37, 
51) use student ratings for faculty evaluation, 
both for the purpose of improving instruction 
and reemployment. 

Ratings of instruction by colleagues, while 
not as popular as pupil evaluation, has been giv- 
еп considerable support. It is argued that by in- 
terclass visitations and through the school activ- 
ities, the peers become sufficiently familiar 
with the work of the other teachers to pass judg- 
ment on the competency of their teaching. It is 
further argued that the process is democratic 
and important in that respect. Evaluation by 
peers presents problems, particularly if no 


class visitation, 
eda system of self- 


is missing in most cases, 
а person evaluate his own 

It can be readily seen t 
of criteria available, 
at least one difficulty 
88 some advantages, 
the case for rat 


When well constructed and 
be lists and rati 


comparable 
interpretati, 


S of selective attenti 
Selective recall, шин 


Pupil Achievement 25 a Criterion 


one may agre 
criterion of 


» Validity im- 
reliable as 

5 reported in ри- 
nsistently low. 

Чѕе the Criterion of pu- 
nstruction, Some School 
Pupils take Standardize 


š "t. Reliabiliti 
pil gain studies have bien 2 

Many school People 
Pil status to 


evaluate 1 
districts require that 
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je 
tests at the completion of the school year. А 
tain states have statewide testing Migne ее 
pupil promotion is based on the score pro the 
on that test. The teacher is evaluated wu" 
basis of whether her pupils pass or fail. SCR 
this practice of teacher evaluation is decr 
ing, it is not extinct. | пав 
"Such а practice is unfair in that it goes ein 
take into consideration the ability of the p ptm 
to learn nor the conditions under which Ше 
ing takes place. Ап improvement was m t quo- 
when schools came to use the patate үл 
tient which considered the intelligence ша gen" 
pupil. Using the formula score гага 2d min" 
eral average of the class plus HORE (17) 
us Ше average І. 0. of the class, Broo с 
rated Ше teachers in his district. He says, 


In addition to a substantial general 
raise in salary throughout the district, 
the school boards were persuaded to 
grant special increases of one or two à 
dollars per week to teachers who rate 
ninety-five percent or better. 


s fell 


With the passage of time these procedure ts and 


into disrepute with both curriculum exper 1 
Statisticians. 018 
The modern educationist claims that Яо 
must teach more than subject matter an sonal” 
attitudes, appreciations, ideals, and per 
ity improvement are equally important. 
Coy (23) in 1930 warned that the = 
ment quotient could be used to evaluate даса” 
only under specia] conditions. Modern Лаа іл” 
tors realize that many other factors Бі re^ 
telligence affect pupil grades and have = шал 
gression equations and similar techniques, rid 
attempt to predict the scores that pupils отер” 
obtain if instruction were equal. The Л the ас” 
апсіев between the predicted scores ап sure 
tual scores have then been used as a mea 
of the effectiveness of the teaching. 4, 43) 
Almost any book on measurement (55, о 
Cuss the measurement errors to we егей 
t procedures are subject. The test 5 орар 7 
of a pupil simply indicate that, in all Qut 5 
ity, his “true” score is within certain ipa ре 
of the score he produced on the test. А actor? 
pil accomplishment is affected by many torilY 
Which we are unable to measure satisfact се 
at the present time and it is questionable teach” 
ever will. Many agencies other than шет ate? 
ers affect learning. Parents, books, Pla" си 
television, radio, and many other pd 
vate and direct learning in present day > the 
À common danger which arises out o of 
testing of Subject-matter is the tendency the 
teachers to prepare for the test by urgin£ 5 
student to cram апа memorize test item” 4d 
rather {һап emphasize understanding ап 


lish" 
рете 


will 
Ї 

915 

tes 
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Concepts. 

А great deal of emphasis has been placed on 
Pupil gain as a measure of teaching effective- 
1686, Thorndike (1143) points outthat difference 
Scores have a low reliability, often approaching 
аа Thus, they may have little ог no validity 

measures of teaching effectiveness. 

‘Many tests are so constructed thata large 
Де is quite easily obtainable if the pupil has а 
un pre-test score, but gain may be restricted 
: ns Original score was high. This is езрес- 
ч ly true if the test has a low ‘‘ceiling’’. Thus, 
шон gain is considered as the difference be- 
h сеп the pre-test and the final, the pupil who 
зад а high score оп the pre-test is under а con^ 
i ANA handicap. Special statisticalandgraph 
zu techniques have been used to compensate 
к this handicap. In most instances they have 

proved to be entirely satisfactory. 


Summary 


of 5 Study of the criteria used for the evaluation 
th aching effectiveness leads one to appreciate 
а difficulties present in all phases of such re- 
аА The importance of evaluating teachers 
ide forced educational leaders to use such meth- 
Yel as exist since new methods have not been de- 
ine. The great questions facing education 
Y in this area are the following: 


€ Can these criteria be used singularly and 

pendently or must composite measures be 
огтеа 2 

№ 2. If composite measures аге formed, what 
Sighting must be given each component ? 

r i Can other measuring devices ofgreater 
Cliability and validity be developed? 


SECTION Ш 


THE METHOD OF THE INVESTIGATION 


т А 
he Design of the Investigation 


1951 URING THE fall semester of the 1950- 
of E School year, 101 graduates of the College 
ducation, University of Wisconsin, who hold 
Whil niversity Teachers Certificate were visited. 
Blo е teaching at the school where they were еш 
Из Уе4. These visits were part of a followup © 
о ана ев by the School of Education. The 
Dose of the visitation program was two-fold. 
: е first place, ап attempt was made to gain | 
сіңі ation concerning the problems of these be 
ble ing teachers and given them any help pos 
teap the second place, ап evaluation o еп 
9 Ching was made in order to check Ше results 
University program 


of teacher training. 
The success of these new teachers during 
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their first semester was determined by several 
methods. A team of two visiting supervisors 
rated them on a short form of the Wisconsin 
Adaptation of the M-Blank during their trip to 
the school. At the same time they secured an 
“acceptability rating" from the principal by 
means of an interview. Тһе ‘‘acceptability cri- 
terion" was broader than the usual evaluation 
in that it was concerned with the teacher as a 
member of both the school and the community. 
Another measure of the beginning teacher's ef- 
fectiveness was obtained on а “‘participator’s 
rating scale". 

After considering the criteria employed in 
the 1950-1951 studies, the writer felt there was 
a need to see if the criteria used were compre- 
hensive enough to measure teaching effective- 
ness adequately. This is not intended to be а 
criticism of the previous study which was very 
well done by thoroughly competent and sincere 
individuals. The previous investigations served 
to stimulate this writer to search the literature 
for a definite relationship among the criteria 
commonly employed in evaluating teaching ef- 
fectiveness. Specifically stated, the problem 
settled upon was to discover what relationships, 
if any, that exist among such criteria as prin- 
cipal’s ratings, pupil ratings, peer ratings, 
self rating, and criteria based onpupilachieve- 


ment. à 
The writer worked with the Teacher Person- 


nel Research Committee, University of Wiscon- 
sin. The Committee gathered considerable data 
about Wisconsin graduates in the field during 
1951-1952. 

One descision of the committee was to set 
up a testing program for the pupils taught by 
the teachers to measure their attainments in 
the subject matter areas. The original plan 
called for a measurement of achievement inthe 
area of concommitant learnings as wellasfoun- 
dationallearnings. After some discussion the 
measurement of concommitant learnings was 
omitted by the committee Тог two reasons. They 
felt that such items ав appreciations, attitudes, 
interests, and personality are subject to large 
measurement errors. Grave doubts were ex- 
pressed as to our ability to measure gains in 
these areas. Furthermore, since the pupils 
taught by these teachers are in high school and 
subject to the influences of a number of teach- 
ers as well as classmates and others, it was 
decided that if gains were detected in these ar- 
eas, there would be no real justification for 
ascribing these gains to the teacher being stud- 
ied. Since the subject matter areas tend to be 
more specialized, such changes might reason- 
ably be expected to be the effect produced by 
the teacher in that area. It was recognized that 
some changes may result from maturation. The 
comparison is, however, of teachers whose 
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classes contain a number of pupils, where in it 
seems reasonable to assume that the mean of 
the gains resulting from maturation will be ap- 
proximately the same for the various schools. 
The addition of a constant to the mean gain 
score produced by the teacher is immaterial 
because the purpose is to rank the teacher rather 
than determine his absolute effectiveness. 

In consideration of the fact that factors other 
than the teachers influence learning, measures 
were obtained of the status of the pupils with re- 
spect to intelligence, age, and average scholas- 
tic standing in order to determine how much of 
the learning could be attributed to these factors, 


assuming that the effects of all other factors are 
negligible, 


Such а measure is 
t are due to differ - 
riables which af- 
ect learning have been removed, 
Since the scores of pupils on achievement ex- 

minations are occasionally regarded аз а cri- 
terion of teacher efficiency, it was decided to 
use this as one of the criteria to be Studied. Ac- 
cordingly, a score was predicted for each pupil 


by means of a regression equation. 
difference for ea 


ences in the groups of those уа. 
f 


the 1 
8565 taught. Асе Инет 
‘ached to Select - 
teachers whose classes Would. ens of 30 to 35 
to the testing Drogram most атепађе 
Since the Study is со 
M nCern 3 Р А 
the teaching effectiveness of hee а 
u- 


* А11 references to Appendic, 
ез пау be found in the Li 
Libr 


(Vol. ххш 


ates, it was decided to select Ше group to at 
studied from the group visited last ДИ ин 
that group only 64 were teaching in ur re- 
high schools during the current year. hearme 
mainder had left the teaching field for Е 
Services, marriage, more lucrative ramp" 
or other fields that seemed to be more Fen group 
ible with their interests and abilities. lection 
under consideration was augmented by ве of Wis" 
of other 1950 graduates of the University After 
consin teaching in the state high schools: Sim 
a preliminary screening a questionnaire on the 
(Appendix Па)* was sent to each | cpu of 
list of eligibles. Approximately 89 per 
the group returned the questionnaire. exam” 
The 73 returned questionnaires were lass 
ined with respect to courses, length за used, 
periods, class size, grade level, text ates 
and willingness of the teacher to соорега were 
the basis of this inspection, 32 teachers wer, 
selected for participation in the study. d 
two teachers were dropped from the an НИЙ 
one case the teacher changed pu be 
the school year. The other was found atly fro 
teaching in a position which differs Ве the Um” 
the circumstances under which most 0 
versity of Wisconsin graduates teach. sample 
Almost every attempt to show that a from 
is representative of the total population pe, THe 
which it is drawn is predestined to баага те" 
investigator may stratify the pa e sir 
Spect to as many variables as һе may ntativ® 
and ascertain that his sample is represe Mao" 
of this larger population insofar as the weve”? а 
teristics considered are concerned. НО pe use" 
Since the number of variables which n inve? 
to compare groups is almost infinite, "рапа 
tigator must draw the line at some poin oessa"! 
Sume that further comparisons аге unn 
and irrelevant. the 
The comparisons are irrelevant hp а Qm 
basic criterion for comparison does no sti tio 
злу affect the trait which is under ілуе Нор 
Since this study is concerned with the fective” 87 
Ships of various criteria of teaching v шерге 
ness, and по information is available 2 ect 4 
ent time as to the way in which factors 654 
teaching effectiveness as measured БУ Е: һ cou! се 
criteria, there is no characteristic Шнек gi, 
not be assumed to be irrelevant. Hower вот 
it is reasonable to suppose that there a nese t 
factors which do affect teaching effectiv resen 
an attempt is made to show the group rep сол” 


а я f Wis р 
ative of graduates of the University 0 
Sin. 


18 

eT 

The writer is aware that there is son) mp 
1 


involved in making inference from this um е 
to Ше larger population. However, he ight Е 
that to restrict any conclusions which ™ 


ary; University of Wisconsin, 
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Чгалуп to the group studied alone is pointless. It 
15 pointed out that inferences drawn in sampling 
Studies may also be in error, but possess the 
advantage that the investigator is in position to 
State the probability of being in error. 

It may be profitable to see how these select- 
ед teachers compare in some respects with an- 
other group of 1950 College of Education gradu- 
хэв. Мг. Harley E. Erickson of Super ior 

tate College, Superior, Wisconsin, Was con- 
Pepe conducting a factorial investigation of 
n e teaching abilities of the 64 teachers frequent- 
ы referred to in this section. TableIgives а 
rief comparison of the two groups. 

The small differences which exist in mean 
решете rank on the Psychological Examina- 

ion and in high school class between the two 
Sroups may possibly be explained in that our 
&roup is composed of teachers in the academic 
PY сетер and does not include fields of special 
d ilities such as fine arts, home economics, in- 

ustrial education, and music. The sex differ- 
епсе may possibly have risen from the same 
Cause, 
of Ё Table II the group is compared with groups 
с һе 1948 and 1949 graduating classes of the 
oe of Education, University of Wisconsin, 

asis of means and standard deviations 1n 

ыта! grade point average. It would appear 
ior Хар group studied herein is slightly super” 
ге, the other groups in this respect. This dif- 

егепсе may possibly be the result of selective 
ie yr a such as the restriction of the group 
зе eachers of academic subjects and that by the 
te, Cond year a number of people have left the 
_ Caching profession. 

The teachers studied in this investigation may 
of sing as representative of the population 
tea ISconsin College of Education graduates | 
qu ina in this state, They have met the ге 
to тле Гог entrance to the University and 
райе College of Education. While enrolled in 

College of Education they have all pass ed 
Tough approximately the same training ехрег- 
псе and indoctrination. Upon graduation they 
In the Secured positions in the state high schools. 
er езе andother respects they have certain 

on of homogeneity that are inescapable. Whit 
мане аге many aspects in which the parent poP 
lon is heterogeneous this is also true of the 
Ur Group, 
imasofar as can be determined at | 
°, the group does not differ radically from 


E а " g= 
ist parent population. Small differences de К 


ie 


t the present 


vi 
riens Since the same selecti 
t be expected to operate in hi 
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һауе in Ше past, one might well expect this 
group to be truly representative of teachers ob- 
taining the University Teachers Certificate and 
employment in the State of Wisconsin. Infer- 
ences drawn from this sample can be applied 

to the general population if one wishes to make 
the assumptions noted above. 


Data-Gathering Devices Employed 


The measuring devices used in this study 
may be considered in two groups: (1) those ap- 
plied to the teacher, and (2) those applied to pu- 
pils taught by the teacher. The measures ap- 
plied to the teachers are rating scales of var- 
ious types. Three of these scales are adapted 
from Student Reaction to Instruction Question- 
naire developed my Roy C. Bryan of the camp- 
us school at Western Michigan College of Edu- 
cation, Kalamazoo, Michigan. The measures 
applied to students are achievement tests in 
subject matter areas. The tests used inthis 
study were selected after securing the opinions 
of experts in these particular subject matter 
areas, by reference to Buros (66) and by inspec- 
tion of copies of the tests. No test was used if 
its reliability did not exceed 0.90. A form (Ap- 
pendix II. B) was sent to each school to secure 
information about the age, intelligence, and av- 
erage scholastic standing for each pupil in the • 
classes where the achievement tests were given. 

The teacher rating scales used are listed: 


1. A short form of the Wisconsin Adaptation of 
the M-Blank. Originally M-Blank, Data for 
Individual Staff Members, 1940 edition, Co- 
operative Study of Secondary School Stand- 
ards. (Appendix II. C) 


2. A pupil rating form—adapted from Bryan. 
(Appendix II. F) 


3. A teacher self rating form —adapted from 
Bryan. (Appendix IL E) 


4. A peer rating form—adapted from Bryan. 
(Appendix II. D) 


5. Administrative X Criterion (confidential, i.e., 
not open for inspection). 


Pupil Achievement Tests: 


1. Typing— Competent Typist Test 
Gregg Awards Department, 330 West 42nd 
St., New York 36, N. Y. (Appendix III. A) 


2. Mathematics 7—Colorado State College 
Education Basic Skills in Arithmetic Test, 
Form À, Grades 6-12 1945 Chicago Sci- 
ence Research Associates. (Appendix Ш. В) 
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TABLEI 


COMPARISON OF VISITED GROUP AND OUR GROUP 


Characteristic Our Group Visited Group 


Number 30 64 
Sex 1ТЕ 13М 30Е 34 М 
Mean Grade Point 1.96 1.94 


Mean Percentile, 
American Council, 


Psychological Examination 69.0 65.8 

Mean Percentile in 

High School 84.5 15.7 
ТАВЬЕ П 


COMPARISON OF GROUP WITH 1948 AND 1949 GROUPS 
ON SCHOLARSHIP 


Characteristic Sample 1948 1949 
Number 


29 205 102 
Mean 


Standard Deviation 


TABLE III 
ME 
ANS AND STANDARD ыы. OF VARIABLES (COURSE 1) 

Item 

Age P.R S.A Р.Т Е с 
Меап 

15. 15 39.59 
м 6.27 13.30 17.34 4. 03 
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3. English—Smith, D. V. and McCullough, C. 
M. Essentials of English Test Form A, 1939 
Minneapolis Educational Test Bureau. (Ap- 
pendix Ш. C) 


4. General Science—Educational Testing Ser- 
‚\1се Cooperative Science Test, Form Y 
1948 New York Educational Testing Service. 
(Appendix III. D) 


5. Algebra— American Council on Education, 
Cooperative Algebra Test Form 8 1942 New 
ed Cooperative Test Service. (Appendix 


€. World History—American Council on Educa- 
tion, Cooperative World History Test Form 
Y, 1948 New York Cooperative Test Ser- 
Vice. (Appendix Ш. Е) 


Sources and Collection of the Data 


E methods employed in collecting the data 
пате ious segments varied considerably. It is 
Шер that this exposition of the sources an 
pe of collecting of data will be presented 
io lucidly if the data relative to each criter- 
n аге presented separately. 

ва rating of the teacher by his principal was 
Ada, ees on the one page form of the Wisconsin 
athe оп of the M-Blank. А sampleott 
не letter sent with it to the supervising 
is ех ipal are in Appendix П.С. The principal 
rom i cm to list what he considers to be the 
in th nding elements of strength and weakness | 
thane Work of the teacher and to make any com 
сіра], Which һе deems appropriate. The prin- 
ion was also asked to give an overall evalua- 
uatic In this particular study the general eval- | 
um оп only is considered and is recorded in со! 

n М of Appendix L. B. The ratings run {гот 
our Superior to 5 for inferior. Teachers and 
са аге indicated by coded num : 
is dim К. the rating of a teacher be used Ю 
ual, advantage by some unscrupulous ілді 
М Аза result š ti of the par- 
ticipati ult of the fine cooperation 
тете principals, the ratings of the m хай 
i на from five pupils taught by =. № 
Тен ia Dh Several schools the administrati 
their t pupil ratings were not desirable f pr 
ала пре өтеді These wishes were respec T 
main € appropriate spaces in the data asp 
dress 21k. Five forms and five stampe 
With the сне were sent і 
n equest that five pup! ' 
cae to rate their ПЕ рет The instructions 
Pater a. with all rating scales wer 
Of 9 remain anonymous. The 10; Т” 
rat Questions on which the pupil is aske 

е the teacher. шап attempt to overcome 
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the tendency to overrate, the pupils were asked 
to divide all the teachers they have had into 
five equal groups according to excellence. The 
pupil is then asked to indicate which fifth the 
present teacher fits. In recording the data in 
Appendix I. B. columns, 2 to.6 inclusive, 1 ш- 
dicates the best fifth, 2 for the second fifth 
and so on until the worst fifth is 5. 

The peer rating form (Appendix I. D) is very 
similar to the pupil rating, except some sub- 
scales for rating differ. This form was sent to 
two teaching colleagues of the teacher. Тһе ге- 
sults are tabulated in Appendix I. B. 

A self rating form was also sent each teach- 
er with instructions to send in a rating of his 
own teaching. The form which was an adapta- 
tion of Bryan's Pupil Rating Scale is very sim- 
ilar to the peer and pupil scales. (Appendix П.Е) 
The same scale of values is used in recording 
the data as in the other two cases. (Appendix 
LB 
M the Administrative X criterion is con- 
fidential, no information about it other than 
the method of scoring willbe given here. The 
largest numerical score that may oe attained 
isfive. The higher score indicates the poorer 
teacher. 

There are 7 areas in which pupil achieve- 
ment was studied: English 9, English 11, Typ- 
ing, Mathematics 7, Algebra, General Science, 
and Modern History. A few teachers had clas- 
ses in two areas and were tested in both. Since 
achievement in these subject matter areas was 
to be compared on the basis of standard scores, 
а minimum of five classes in each area was de- 
sired. Several of the course areas were below 
this minimum. Consequently, several test 
groups were set up in several cities using 
teachers who were comparable in training and 
experience. Data for these groups are located 
in the Appendix I. А with letters as code for 
teachers rather than numbers. 

The pupil achievement program was carried 
on with the aid of the school principals. Tests 
were sent out witha letter (Appendix II. B) to 
the principal requesting that the test be admin- 
istered under his supervision. Most of the 
tests were given in December 1951. Тае tests 
were returned to the Teacher Personnel Re- 
search Committee which scored them and sent 
copies of the scores to the teacher and princi- 
pal involved. In the spring tests were again 
sent to the principals with instructions to retest 
the group 70 or 75 school days after the initial 
testing, depending оп the course. So far as 
сап be determined, аП tests were given on 
schedule except one. That test was given 68 
days after the first testing instead of the pre- 
ie bel 

n cause it might possi 
used to identify the teacher. The ree em 
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Scores together with the measures of intelligence, 
age, and average scholastic achievementare tab- 
ulated by classes in Appendix I. A. 


The Treatment of the Data 


The intercorrelations of age, intelligence, 
and average scholastic standing were calculated 
for each course. These correlations were tabu- 
lated ina matrix. Using the Aitkin Method of 
Pivotal Condensation (62:89), prediction equa- 
tions weré set up for each course to predict the 
pretest scores. Тһе mean of the discrepancies 
between the actual scores and the predicted 
Scores was obtained for each class. The class 
discrepancy was regarded as a measure of the 
effectiveness of that teacher. A standard score 
for a teacher was calculated by subtracting the 
mean discrepancy for the entire course from 
the mean discrepancy in the class and dividing 
the difference by the standard deviation of the 
mean discrepancies for the course. The teacher 
may be ranked by these standard scores if the 
assumption is made that the teachers in one 


course are equally Competent as those of another. 
Rather than make this assumption it was decided 
rovided with the tests 
О their groups. A con- 
В standard score, 

By multiplying the scores 
ll values are positive, 

rent groups should be com- 
е been multiplied by the 

re in the group to the mean 


› it is common to 


г. d rath 
€ initial score į Sn кеде 


ments of the pretest 


Changed. In Some o 
for the low pretest 


Scores in the segment of pretest scores where 
the corresponding pretest score is located. 

The intercorrelations of the adjusted “авна” 
with аве, intelligence, scholastic Без pn , 
and pretest scores were used to feleun, a В 
prediction equation for gains. The mean жүй 
crepancy of actual gain minus predicted де e 
used as a discrepancy score for each tea ch 28 
Teachers were rated оп Шезе discrepancy Yo 
by the same process as on the pretest and fi 
Score discrepancies. 

In some of the cases it was found that р” 
prediction equation accounted for less Буга ава 
percent of Ше variance. In these cases th the 
tual mean gains were used as measures of 
teachers’ effectiveness after the mean gains да 
had been converted to rankings by the standa 
Score techniques mentioned before. а 

After ratings and rankings of the реВ 
have been obtained by all criteria, the relati 


аг” 
Ships among these were determined by the Ee 


Son product moment correlation formula. 


SECTION IV ` 
THE ANALYSIS OF THE DATA 


THE МАТОВ purpose of this investigation 
Was to study the relationships among бега а> 
Criteria of teaching effectiveness. Data scs 
ing the success of thirty graduates of the Co in 
lege of Education, University of Балин Л”, 
Ше second year of Service were collected. tion 
types of data collected with a short expla em 
of the symbols employed and the scoring SY are 
of each will be reviewed. The original data 
presented in Appendix I. one 

l. A rating of teacher by principal on p 
page form of the Wisconsin Adaptation of t : 
M-Blank. Symbol M; scoring range of олы реет 
five with the lower Score indicative of the 
teacher, 

2. A rating of the teacher by pupils on one 
adaptation oí the Bryan Reaction to шеше 5 
Questionnaire, Symbol Pu; scoring same JE 
above for M. Total of five pupil ratings 95 
in calculations. a 

3. A rating of the teacher by himself оп 1р01 
Specially adapted Self evaluation form. Syn 
Se; scoring same as M above. ues 

4. А rating of the teacher by his colleag cor" 
9n the peer-evaluation form. Symbol Pe; oe 
ing as M above, Sum of two peer ratings Ч 
in calculations, 


on 
5. A rating of teacher by another agency 


: 01 А O 

а Special Administrative Criterion. Sym score 
163 SCoring range of five upward, Lower 
indicates 


better teacher, | tion 
` Pupil scores on an initial administra 
of standardized achievement tests. Cours 


(Vol. XXII 
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, 19 
"S ANDERSON 


TABLE IV 


INTERCORRELATIONS OF VARIABLES (COURSE 1) 


Age Р.В. S.A PT F G 
Age 
Р.В = „212 
5.А 0.270 - .585 
Р.Т - .138 0.597 - 550 
Е. = 323 0.66 -.555 0.848 
G 0. 349 0.291  -.169 -.116 0. 520 


TABLE V 
PREDICTION EQUATIONS FOR COURSE I 
P.T.' = 0.17 P.R. -1.40 S. A. 415.3 
i = 0.11 P.R. - .248.А. + 0.81 P. T. ‚3.8 
+0.11 Р.В. -16.0 


с" - 5.00 Аве 


ТАВЬЕ УТ 
DEVIATION OF VARIABLES (COURSE п) 
(N = 79) 


Пет Age p.R. S. A. P. T. F. (5. 
5.29 929 16.87 6.15 


Mean 15.24 51.75 
. 875 25. 62 2.36 4.15 4.97 4.09 


MEANS AND STANDARD 
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TABLE VII 


INTERCORRELATION OF VARIABLES (COURSE II) 


Age P.R S. A. P. P F G 
Абе ьа 
Р.В. = „103 — esses 
S. A. - .008 o NET 
P. T. - .342 0.381 = „2066 pragia 
Е. = „169 0. 369 = .372 9:65 захд 
А.С. 0.056 0. 174 = .205 0. 003 006808 xs 
TABLE VIII 


PREDICTION EQUATIONS FOR COURSE II 


вт. 


71.70 Age %0.054 Р.В. = .332 8. A. -34. 2 
E. 


0. 019 P. R. -0. 415 S. A. +0. 548 P. T. 


A.G.' not used; cannot account for 10% of variance. 


TABLE IX 
MEANS AND STANDARD DEVIATIONS OF VARIABLES (COURSE ш) 
(М- 99) 
Аве 19. $.А. P. T. F. A.G. 
Me 
an 12.40 105. 64 5. 75 46. 13 54.54 8. 555 
8. 
р. 0. 62 12.90 2.67 
= 


10. 63 10. 12 4.58 
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TABLE X 


INTERCORRELATIONS OF VARIABLES (COURSE Ш) 


Age 1.0 S. A. PT. F. A.G 
AES sage i 
s 2568 ait 
оф? 0.361 = Ü wene 
Ee - .197 0. 481 = „7190 | exis 
И - .238 0. 494 - .704 S870 2... 
б. - 2014 0.128 - .004 - .074 0.337 ...... 


ТАВЬЕ ХЇ 
PREDICTION EQUATIONS FOR COURSE Ш 
BT! = 1.732 Age -3.288 S. A. +43.562 
rà i = 0.085 1.0. +0. 095 S. А. + 0.797 P. T. 48.29 
percent of variance. 


TABLE ХП 


D STANDARD DEVIATIONS OF VARIAB 
N = 95 


МЕАМ5 АМ 
Age p.R. S. A. Р.Т. Е. G, 
5.37 14.50 21. 63 1.13 


LES (COURSE IV) 


Means 15.02 65.65 
Зыр, тн" С” 1.53 10.23 6.18 
ТАВЬЕ ХШ 
INTERCORRELATIONS OF VARIABLES (COURSE IV) 
Age Р.В. 8.3. Р.Т Е. с 
Age ip 
Р.В = „115 D 
S.A PEE NEC 
Р.Т = 1122 өле 5-8 26 
Е. ы: 1 0.557 216671 0.799 ...... 
с. 0.13 0.180 - .366 0.105 0.612 2 
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are coded by number. High score indicates at- 
tainment of desirea objectives. Symbol for in- 
itial test score is P. T. 

T. Final scores on certain standardized tests. 
Same as above with F to signify final. Scored 
as number 6. 

8. Pupil Age measured in completed integral 
units, Symbol А. 

9. Pupil rank in intelligence. Symbols used 
are P. R. for percentile ranks on Statewide test- 
ing program involving Henmon-Nelson Test of 
Mental Ability and I. Q. for intelligence quotient 
on Otis form A. 

10. Average Scholastic 
School. Symbol is $. A. 
to 12, with 1 соггезроп 
Бы... ; 12 to F. 


Standing in high 
> SCored on scale of 1 
ding to A, 2 to A-, 3 to 


tion, priority is given to that treatment, 

and standard deviations of the 
ages, percentile ranks in intelligence or intelli- 
gence quotients, average scholastic Standings, 
initial and final test scores on the achievement 
examinations, and gains or adjusted gains ar е 
listed in Tables Ш, VI, IX, ХП, XV, XVIII, and 
ХХІ. The number of cases on Which each of 


а Statistics was computed is given in each 
e. 


are given. Опе обн 


tested only one time. The upper Correlation in 


each cell is based on 103 cases while the lower 
used only 83. The Correlations # 


on the 83 cases, 


Beta coefficients for Prediction equations іп 


те Computed from the in- 
Course group by the А 
Method of Pivotal Cond р by the Aitkin 


ensations (62:89-95 - 
Standard score equatio шелді 22 


апа ХХШ. 
иг” the time that the beta coefficients were " 
computed, multiple correlations were also ca 
culated. If one adds variables to an equation Й 
of this type, one expects Ше multiple correla _ 
tionto increase. И it does not, the added yd 
iable has not improved the prediction that са 
be made by the use of the regression ри 
In this computation, if the multiple correlati 
Was not raised by an increment of 0. 02 on e d 
addition of a variable, the variable was omit ° 
from the equation. Consequently, some aja 
tions have only two independent variables a 
others have three or four. И this general рг и 
cedure failed to raise the multiple percipe uan 
above 0.3, the regression equation was йе 
up in raw score form because it fails to ta € 
account of sufficient variance to make the ope 
ation worth the effort involved. 

AS а result of the consideration mentioned 
in the preceding paragraph, only three predic- 
tion equations were set up for predicting gains. 
Later it was decided to use only such equations. 
Whose multiple correlations exceeded 0. 5. This 
eliminated all but one gain predictor. Since this 
one did not differ materially from 0.5 it was de: 
cided to omit it also. АП the multiple correla 


tions for the various prediction equations are 
given in Table XXIV. 


Although it was not feasible to measure tea- 


edictive value. Since we 
ary means for predre th 
hat gains are equally likely 
to appear in each class if we disregard the in- ы 
fluence of ще teacher, Accordingly the assess 

я hing effectiveness in terms of actual 
gains Or gains adjusted for pretest handicap was 
Substituted for h 


the proposed criteri of the 4187 
crepancy betwe р Criterion 


еп actual i gam 
hy and predicted m 
The mean discrepancie i и 
sf Шеге 
classes between t e d prodi 


ге sum 
Same type of infi 


The letter D is 


While the Subscripts рапа Е refer to the prete? 
and final respectively, 

When the means of the gains for each each 
pretest score Vere graphed versus the pretes 
„сате apparent that definite ще 
Эн беп pretest and gain 10 
ich oa; апа УП. In all of these | 
courses high gains tended to be associated wit 
OW pretest scores, Accordingly, the baseline 


(Vol. ХАШ 
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TABLE XIV 


PREDICTION EQUATIONS FOR COURSE IV 


Pp. T.' - 0.125 P.R. -1.15 8. A. +12. 47 ° 
Е. ' = 0.018 Р.Е. -1.105.А. + 0.82 Р.Т. | +14. 44 
с.! = - .004Р. К. - .89 S. A. 412.14 


Oe NEM аа ы 


TABLE XV 
MEANS AND STANDARD DEVIATIONS OF VARIABLES (COURSE V) 
(N = 105) 
¿_ _— — eC E G 
Age Р.В. 5.А. Р.Т. Е. G. 
Means 14.39 55.92 5.43 22.49 29.09 6.60 
S.D. 0. 67 26. 02 2.45 9.14 12.53 7.95 


ы O SM еее — — = 


ТАВЬЕ ХУІ 


INTERCORRELATIONS OF VARIABLES (COURSE V) 


Age Р. В. S. А. Р.Т; Е. с. 
Age eee 
Р.В. 2.297 
S.A. 0.356 -.564 e 
P. T. - .093 0. 424 = 481 apewe 
F. - .144 0.521 - .514 0.774 22. 
с. - .119 0.333 - .256 0. 070 Н.”” 


ТАВЬЕ ХУП 


PREDICTION EQUATIONS FOR COURSE V 


Шоу === 


Р.Т.! = 0.079 Р.Н: -1.317 5.А. +25.24 
Жыз = 0.093 P. R. - .4155.А. + .887 Р. Т. 46:51 
в.“ = 0.085 Р.В. - .3245.А. + 3. 63 


скины 


` 
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TABLE XVIII 
MEANS AND STANDARD DEVIATIONS OF VARIABLES (COURSE VI) 
(М = 147) 
Аре Р.В. 5.А. Р.Т. F. G. 
Means 13.95 49.84 5.85 87.48 94.61 7.04 
S.D. 0.54 25.85 2.48 15. 00 12.98 12.24 
TABLE ХІХ 


INTERCORRELATIONS OF VARIABLES (COURSE VI) 


TABLE XX 


PREDICTION EQUATIONS FOR COURSE VI 


Р.т.! = 0.200Р. В. 72.418. A. *91.58 
É! = 0.072 Р.В. 7.13 S. A. 


+ .550Р.Т. 
A.G. t 


+47. 24 
not used; cannot account for 10 percent of variance 
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TABLE XXI 


MEANS AND STANDARD DEVIATIONS OF VARIABLES (COURSE УП) 


Асе Р.В. 5.А. Р.Т. Е. А.С. 
Меап 16.37 50.00 5.69 93.50 101.02 7. 34 
S.D. 0. 74 28.85 2.29 18. 43 16.78 14.71 
N 83 83 83 83 83 83 
Mean 16.36 48. 86 5. 11 94. 71 
5.0 0.14 29.34 2.30 18.12 
N 103 103 103 103 


TABLE ХХП 


INTERCORRELATIONS OF VARIABLES (COURSE VII) 


Age* p.R.* 8,8. * р.Т. Е. А.С. 
Age ee 
P. R.* = РО сени: 

- .340 
5.А.* 0.286 2.543 © ӨӨ 

0. 326 520 
Рот.“ - 281 0. 490 api | енеда 

- .280 0. 484 - .518 
Е. - .408 0. 607 - .595 0.858 ...... 
A.G. - .060 0. 191 - 2098 - .063 ЊЕ azizi 


* Two sets of correlations given; 


upper number based on 103 cases, lower set 


based on 83 cases. 
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TABLE XXIII 


PREDICTION EQUATIONS FOR COURSE VII 


Р.Т.! = 41T p n -3.190 S. A. +104. 260 

.260 
Е. ! = 2.143 Age +0.105 Р.В. - .1998.А. +0.620 Р.Т. +87 
А.С. 


not used; cannot account for ten percent of variance. 


TABLE XXIV 


CALCULATED MULTIPLE CORRELATIONS FOR 
REGRESSION EQUATIONS 


Course Р.Т. Е с. 
1 0.64 0.87 0.53 
n 0.51 0. 66 * 
ш 0.80 0.87 * 
IV 0.70 0. 83 0.35 
у 0.51 0.80 0.34 
УТ 0. 64 0. 81 * 
УП 0.59 0. 90 * 


*Indicates multiple correlations less than 0.3 
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| MEAN DISCREPANC 


TABLE XXV 


IES BETWEEN РВЕТЕЗТ FOR EACH CLASS 
AND PREDICTED PRETEST 


— ае po, бе T 

I 27 - .81 19 42.52 

A + „98 16 - .50 

|? в +1.34 у 14 - .11 
| 28 - .66 16 - 187 
| 5 29а - .94 12 = „73 
29b -1.26 15 43.25 

H 20 41. 00 13-0 -3. 49 

22 -1.23 VI 4 37.36 

23 -1.50 1 -1.90 

24 - 298 3 -1. 78 

25 41. 07 1 -1.97 

26 + 85 8 -2. 73 

ш 31 +3.97 5 4,29 

с - „28 уп 11 +6. 12 

32 -3.74 1 +1, 70 

D -1.55 21 +2.27 

! E + .08 10 -1. 63 
к > IV 18 44-10 9 -5.81 
13-Е -4. 44 6 + .28 

27 


AN DISCREPANCY ВЕТМЕЕ 


TABLE XXVI 


N FINAL AND PREDI 


CTED FINAL FOR EACH CLASS 


a Бо 
ТІ Course Teacher р; Course Teacher D£ 
17 +0. 73 


} 
1 21 
А 
в 
28 
29а 
29b 
H 20 
22 
23 
24 
25 
26 
ш 31 
с 
32 


Е 
ту 18 


‚89 
.27 
„д1 
.33 
. 61 
.16 
. 38 


13 


.23 
.98 
TT 
. 12 
.86 
.68 
.20 
.38 
.12 
.92 
.31 


у 


ҮІ 


1 
1 
1 
1 
1 
1 


9 
6 
4 
6 
2 
5 


[o] 


= N 
aoorra 


ГЭЛЭЭ 


41.91 
40. 67 
-6.00 
-0. 71 
+1. 91 
+3. 75 
-2.20 
+2. 65 
42.32 
-2.54 
+4.54 
-1. 67 
-3.59 
+0. 74 
+1. 03 
+1. 44 
-2.10 
+0.28 


жоо) ее 


ш 
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TABLE XXVII 


MEAN GAINS OR ADJUSTED MEAN GAINS FOR EACH CLASS 


Course Teacher G. Course Teacher G. 
I 27 6.40 17 7.40 
А 3. 00 19 9.52 
В 5. 87 16 8.55 
28 8. 75 У 14 0. 28 
29а 0. 00 16 5. 52 
29b 2.53 12 8.59 
п 20 6.40 15 11.21 
22 6. 62 с 5.90 
23 7.52 УТ 4 10. 73 
24 5. 98 7 9.37 
25 5.89 3 5.97 
26 4.77 T 12.33 
ш 31 8, 49 8 4.50 
С 6.30 5 1. 79 
32 9.70 уп 1 4.87 
р 8.39 21 10. 77 
Е 9. 92 10 6. 72 
IV 18 4.34 9 6.07 
F 5.81 6 9.89 


TABLE ХХУШ 


MEANS AND STANDARD DEVIATIONS OF MEAN DISCREPANCIES AND GAINS 
FOR EACH COURSE 


Discrepancies Discrepancies Mean Class 
on Pretest on Final Gains 
Course Mean S. D. Mean S.D. Mean S. D. 
I = «23 0.99 = „02 1.81 4.43 2.88 
П 0. 13 1.12 0.04 0. 62 6.20 0. 83 
ш = „29 2,52 0.03 0.73 8.56 1.29 
IV - „181 2.33 0. 02 1.41 Ч, 12 1. 86 
У = „89 2.15 = „65 3.38 6. 30 3. 64 
УІ = 214 3. 46 0.29 3. 03 7.45 3.68 
ҮП 0.75 5.03 0.28 1.25 7.66 2.26 
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es о scores (abscissa) was divided іп- 
lated үсеше A mean gain ordinate was calcu- 
naka ve each segment. Each gain score in the 
gain for ihe multiplied by the ratio of the mean 
tains its he segment of the abscissa which con- 
in неве ges score. Thus each gain score 
ities a E courses was adjusted for inequal- 
Table eem a at various levels on the test. 
in Course II shows the mean gains for classes 
in Courses 1, IV, and V and the adferre еі 
VI. each class in Courses П, Ш, ҮІ, and 
to 2 ыы and mean gain scores serve 
ia in the е teachers on these particular criter- 
compari various courses. A common device for 
Scores “ар groups of this kind is to reduce the 
and iit a standard score form with zero mean 
group of standard deviation. Any score та 
Score 210 can be converted to standard 
and divi di by subtracting the mean of the group 
€viation £ the group. Them by the standard 
ard деуі Б the group. The means and stand- 
of all c и ions of the discrepancy and mean gains 
Table зе Ses for all courses are listed in 
deviatio Ш. When these means and standard 
апа жайтты were used to convert the discrepancy 
ard Жакс into standard scores, the stand- 
tained for fr tabulated in Table XXIX меге ob- 
tiveness, he three criteria of teaching ейес- 
үө Score distributions always contain 
Ordinar as well as positive numbers. Under 
perfecti, circumstances the signed numbers are 
gation "d acceptable. However, in this investi- 
Pensate е ag correction was made to com- 
able te or the fact that possibly the more сар- 
Staiger 22 may be teaching in one course while 
Plan fo ге teachers are clustered in another. The 
еасһ ten weighting was to multiply the score for 
all puj тлы by the ratio of the mean score for 
ported fo; in that course to the mean Score as ге- 
е low ог the norms. Such a plan would project 
9 the = score in a group down in proportion 
Ча mild of the group on the norms. However, 
ра. is added which will change all the 
ion is Scores to positive values; this objec- 
» Sa Me A constant of five was adde 
are ц standard score. The resulting scores 
Tasted in Table XXX. 
Pupils E XXXI shows the means attai 
the sta. ught by the teachers being evalua 
Means ndardized achievement examinations. ^^? 
Son of the norms are furnished for compari- 
НЫ the scores of Table > were mul 
from т. y Ше ratio of the appropriate шинээ” 
crite Table XXXI, the scores were change 
ria scores as listed in Table XXXH. |. 
€ intercorrelations of these three ed 
r 5 апа {һе Пуе ratings rincipal, саса" 
х МЕ pupils, peers, and administrative criteri! 3 
е Summarized in Table . These со 


Score 
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relations were computed by the Pearson product 
moment formula. Since low numbers on the 
rating scales indicated superior teaching and 
high numbers superior teaching on the achieve- 
ment criteria, the signs of correlations obtain- 
ed using one criterion from each group have 
been reversed to give the usual interpretation 
to the correlations. 

If samples of size thirty had been randomly 
drawn from an infinite population whose true 
correlation is zero, the standard error would 
be 0.18. Only in about five percent of such 
samples would one expect to find correlations 
whose absolute value is greater than 0.36. In 
this set of correlations based on a selected 
group, only seven correlations are of the mag- 
nitude to cast doubt upon the possibility of their 
having arisen аз chance fluctuations from atrue 
correlation of zero. The seven are: 


Correlation of M-Blank with Administra- 
tive Criterion X 

Self rating with principals M blank 

peer with pupil 

peer with Administrative Criterion X 
pretest rating with final rating on pupil 
achievement 

pretest with adjusted gain criterion 
Final with adjusted gain 


- 


geom 


ps 


E 


There may be many who question Ше assump~ 
tion that the means on the norms furnished by 
d test publishers are equally appli- 


standardize 
cable to all these teachers. It may be argued 
correlations among these criteria 


that the inter 
il achievement аге spuriously high 
in that the ratios of the means move subgroups 


of the entire group in 


three criteria. In со 
objection the writer calculated the correlations 


among the criteria scores listed in Table XXX. 
This uses the assumption that the teachers in 
every class are comparable with those of all 
the other classes. Using this procedure the 
correlations obtained are as follows: 


1. Pretest with final 0. 16 
2. Pretest with adjusted gain -. 01 
3. Final with gain 0. 69 


The only one of these that could be considered 
significantly different from zero is the correl- 
ation of final Score with gain. 

As a matter оі interest it was decided to 
check the consistency of the ratings by pupils 
and peers. In the data sheet the ratings by the 
pupils are numbered from one to five These 
are numbers that were assigned to the rating 
sheets before they were sent to the ри 115 "The 
ratings in column Pu, represent the габ à г 
their respective teachers by the pupils eni 
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TABLE XXIX 


(Vol. XXIII 


STANDARD SCORES FOR TEACHERS IN COURSES ON THE THREE CRITERIA 


Course 


I 


Teacher 


= 


юм 
Зона = = сл со = со чњ 


2 Zg 
+0. 49 +0. 69 
=0. 71 -0. 49 
+1. 05 +0. 51 
+1.28 +1.52 
-1. 45 -1.56 
-0. 65 -0. 66 
-0. 68 +0. 24 
+1. 11 +0. 51 
+0. 31 +1.59 
-1. 65 -0.27 
+1. 18 -0. 37 
-0.26 -1.72 
"1.22 -0. 04 
-0.97 -1.15 
+0. 23 +0. 88 
+0. 48 -0. 13 
+1. 49 +1..05 
-1.38 -1.49 
-0. 94 -0. 70 
+0. 50 +0. 15 
+1. 34 +1.29 
+0. 46 +0. 77 
-1.58 -1. 65 
-0. 02 -0.21 
+0. 76 +0. 63 
+1.30 +1.35 
-0. 46 -0.11 
+0. 78 +0. 89 
+0. 67 +0. 52 
-0. 93 -0. 40 
+1. 40 41.33 
-0.64 -0. 80 
-1.28 -1.54 
+0. 37 -1.23 
+0. 60 +1.38 
+0. 93 -0. 41 
-1.90 -0. 70 
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STANDARD SCORES OF TEACHERS W 


Course Teacher 


I 21 
28 
29» 
п 20 
22 
23 
24 
25 
26 
ш 31 
32 
IV 18 


13** 


17 
19 
16 
У 14 
16 
12 
15 


13** 


oar 


ню в 
со O = = = сл со = 


ж Average of Scores 1 
**Can be evaluated over 0 


* 
* 


ne seme 


ANDERSON 


TABLE XXX 


ITH CONSTANT FIVE ADDED 


Sp St g 
4.41 5.49 5. 69 
4.51 6.28 6.52 
4.12 3.95 3. 89 
6. 01 4. 32 5.24 
4. 02 6. 11 5.51 
3. 78 5.31 6.59 
4.24 3. 35 4.13 
6.07 6.18 4.63 
5.88 4.14 3.28 
6. 69 3. 78 4.96 
3. 63 5.23 5. 88 
5. 61 3. 62 3.51 
3.23 ТІГУ “бйз 
5.01 5.50 5.15 
6.21 6.34 6.29 
4.92 5.46 5.77 
5.13 3.42 3.35 
4. 78 4. 98 4.79 
4. 85 5. 76 5. 63 
6. 69 6. 30 6.35 
3.56 шаа T 
7.17 5. 78 5. 89 
4. 50 5. 67 5.52 
4.54 4. 07 4. 60 
4.41 6.40 6.33 
4.25 4.36 4.20 
5.10 3.12 3. 46 
6.07 2... .... 
6.38 5.37 3.11 
5,30 5, 60 6.38 
4. 53 5. 93 4.59 
3.70 3.10 4.30 
4.03 5.00 5.99 


or two sections 


ster only 


. Only pretest used. 
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TABLE XXXI 
COMPARISON OF MEANS OF NORMING AND COURSE 
POPULATIONS 
Course Course Means Norm Means 
I 17.34 21.9 
II 9.23 10.0 
IH 54.54 41.65 
IV 21.63 21.9 
У 29.17 20.2 
VI 91. 04 89. 0 
УП 97. 87 104.0 
TABLE ХХХП 


TEACHER SCORES ON ACHIEVEMENT CRITERIA AFTER WEIGHTING 


Course 


Teacher Cp с Cg 
27 3.49 4.35 4.51 
28 3.62 4.91 5.16 
29 3.26 3.13 3. 08 
20 5.55 3. 99 4. 84 
22 3. 71 5. 64 5. 09 
23 3. 49 4.90 6.08 
24 3.91 3.09 4.31 
25 5.60 5.70 4.27 
26 5. 43 4.38 3. 03 
31 7.66 4.33 5.68 
32 4.15 5.99 6. 73 
18 5.54 3.58 3.47 
13 3.19 жээ нат 
11 4.95 5.43 5.09 
19 6.13 6.26 6.21 
16 4.86 5.39 5.70 
14 1.39 4.93 4. 83 
16 6. 89 7.17 6.90 
12 6. 99 8.30 8.11 
15 9.64 9.08 9.15 
13 b. 13 тэн пи 

4 1.33 5.91 6.02 
7 4.60 5.80 5.64 
3 4.64 4.16 4.10 
1 4.51 6.54 6.47 
8 4.35 4. 46 4.29 
5 5.21 3. 80 3.54 
11 5.11 tw РАЙ 
1 6.00 5.05 3.55 
21 4. 99 5.27 6.00 
10 4.26 5.58 4.32 
9 3.48 2.92 4.05 
6 3. 79 4.71 5.64 


(Vol. XXIII 


ТАВЬЕ ХХХШ 


INTERCORRELATIONS OF CRITERION SCORES OF TEACHERS 


M Pu Se Ре АХ РТ Е. 
OAS ьа 
0. 43 0.30 зная 
0.29 0.38 0,28 ш 
0.57 0.22 0.33 0.40 .... 
- .04 0. 02 = i - .02 0:09: x 
0. 02 0.13 = 48 0.23 0.00 0.09 гга: 
0.10 0. 11 = uo 0.23 0.10 0.54 0. 85 


АС. 


(8861 'лодшојдов 


козияаму 


с9 


TABLE XXXIV 


RATINGS OF THE ACHIEVEMENT TESTS BY THE TEACHERS 


Test Area Rating by Teacher Criticisms or Opinions About Tests 
Mathematics 2 None given in this area. 
2 
World History 3 1. То comprehensive—covers materials not studied. 
28 2. Doesn't measure the ability to reason from facts 
4 of history. 
2 
Typing 2 1. Speed and accuracy are not only aims in typing. 
2 2. Tension results when the principal administers 
4 test. 
5 
2 


Algebra 2 1. Goals other than subject matter should be emphasized. 
* 
2 
2 * letter without rating 
Science 2 1. Too much material not covered in class 
1ог 85 
2 ж 1 оп materials covered; 3 on other items 


о а ii дылы a= === 

English 1. Does not test ability to read for basic ideas and 
interpretation. 

2. Lack of opportunity for individual expression. 

3. Absence of evaluation of literature. 

4. No test for written expression. 

5. Too much emphasis on grammar. 
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а the blanks numbered опе. Тһе other 
simalar have ratings which were obtained in a 
the fs r manner. The scores of the teachers on 
Шо. pupil ratings were correlated. This 
on et ten correlations, each of them based 
teache judgments made by 52 pupils about26 
umbo ers. Тһе seperation of the pupils into 
sent DS was predetermined as the blanks were 
0. 00 pur The range of the ten correlations was 
co о 0. 74 with a median value of 0.42. ша 
oe manner the ratings of the teachers 
ome of teaching colleagues were сог- 
chose с = 0.26). These two groups Were 
ject n as far as possible to represent the sub- 
ing matter area in which the teacher was work- 
grou An attempt was made to divide the two 
inal E into men and women when the two orig” 
Sans ас were sent out. The consistencies 1n 
n аз measured here, are quite loW. 
pupil : evaluation of teaching effectiveness by 
valid achievement on standardized tests is in^ 
Jan эргүү as the tests fail to measure the ob- 
his Has of instruction. In order to check оп 
е ке of the validity of the testing program» 
is а of each teacher to the tests used in 
questi 8865 were sought by means ofa short 
Were ionnaire. (Appendix П.Н) The teac hers 
With askea to rate the test on a five point scale 
ver indicating a very satisfactory test and 
invited једе прије The teachers were also 
felt a О make any criticisms or comments they 
чина бре: Of the thirty-two teachers 1807 
sponded rate and comment, twenty-seven Te- 
and offe; Only a few did more than rate the test 
empt er some brief comment. No second at- е 
ings iae made to secure the five additional га 
еј ecause the school year was almost over. 
nents and comments of the teachers are 
mm ed by classes in Table XXXIV. Only those 
аге ге Which may be construed as criticisms 
Sought ulated because the original questionnaire 
icisms the criticisms only. In general, the cri 
Covey are confined to two categories: (1) tests 
Maggs шы not taught in classes; and 
Value ata objectives are excluded. The m, ва. п 
lve that the ratings of the tests (2.4) is in шэн 
Quate, the tests were slightly better than ? 
к the intercorrelations among the three _ 
Pil ас res of teaching effectiveness based on P 
for ((Шеуетелі are considered after weighting 
Seg ences in accomplishment in the various 
tive с! there definitely appears to bea ре 
on relation among them. The standar een 
domly samples of size thirty is 0. Чт 
а ем сад an intinite е Е 
nd ga; relations among е 
щат Criteria are at least three Ope 
that th It would appear unreasonable ын ите 
^ рес. true correlations аге zero. Ae 
@eviously, the correlations drop $ 
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that they might be regarded as chance fluctua- 
tions from zero for all except the finalwithgain 
criterion (г = 0. 69) if the justification ОГ weight- 
ing groups according to their means is denied. 

When the principal's evaluation on the M- 
Blank was correlated with the.other measures 
of teaching effectiveness, it was found to cor- 
relate 0. 57 with the administrative X criterion 
and 0. 43 with the teacher's self rating. Allthe 
other correlations may be readily explained as 
possible chance variations from a true zero. 
The sum of the pupil ratings was found to cor- 
relate 0. 38 with the sum of the evaluations of 
the peers. No other significant correlations 
were found for this variable. Peer rating cor- 
related 0. 40 with the administrative X criter- 
ion. Self-evaluation was found to correlate 
0.33 with the administrative X criterion. The 
other relationships are too small to warrant 
mention. 

In summary, it would appear from the re- 
sults of this investigation that no appreciable 
relationships exist between rating criteria and 
pupil attainment criteria. Evidently the criter- 
ia evaluate different aspects of teaching effec- 
tiveness. There are low positive correlations 
among the constituent parts of each of these two 
groups of criteria. Whether one uses a com - 
posite criterion ог several separate criteria 
will depend upon the purpose of the evaluation 
undertaken. 118 not easy, even if sometimes 
desirable, to represent effectiveness in a com- 
plex activity such as teaching, by a single cri- 


terion. 


SECTION V 


SUMMARY, CONCLUSIONS. AND 
IMPLICATIONS 


Summary and Conclusions 


THE PURPOSE of this investigation 
was to determine the relationships among сег- 
tain criteria used to evaluate the teaching еНес- 
tiveness of graduates of the School of Education, 
University of Wisconsin. The teaching effec- 
tiveness of а selected group was estimated by 
the use of eight different criteria. The rela- 
tionships among the specific criteria were ех- 

ressed by linear coefficients of correlation. 

The group studied in this investigation con- 
sisted of thirty teachers who received the Uni- 
versity Teachers Certificate in 1950 and are 
now employed in twenty-eight high schools in 
the State of Wisconsin. This selected group ap- 
pears to differ from the universe of graduates 
of the School of Education in that they (1) exhib- 
ita slight superiority in grade point average, 


- (2) have one year of teaching experience, and 
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(3) are teaching in selected subject matter areas. 
With these exceptions, there is no reason for 
not believing the group representative of the grad- 
uates of the School of Education. 

The subjects were evaluated on separate types 
of rating scales by principals, peers, pupils, the 
teacher himself, and an outside agency whose 
identity is confidential. In addition, the subject 
matter achievements of their pupils, as meas- 
ured on certain standardized tests, were used 
to develop three other criteria of teaching effec- 
tiveness. 

Complete data, including measures of intelli- 
вепсе, age, and average scholastic standing, as 
well as the scores on the initial and final admin- 
istration of the achievement examinations, were 
Secured for seven hundred and forty-one pupils 


taught by these teachers. On the basis of these 
data, the teachers Were evaluated as to initial 
test status, final test Status, and pupil gain. 
Pretest status was justified as a measure of 
teaching effectiveness in that three months of 
the school year had elapsed prior to the testing. 
It was assumed that the achievement of the 
pupils is a function of (1) the effects of the tea- 
cher, (2) the intelligence, age, average schol- 
astic standing, and previous knowledge of the 
subject, and (3) other factors not mentioned, 
Regression equations were set up which predict- 
ed the achievement to be expected on the basis 
of the measured pupil factors. Whenthese pre- 
dicted achievements were Subtracted from the 
actual pupil achievements, the residuals were 
considered to be the results of the efforts of the 
teachers plus the effects of the unmeasured fac- 
tors. It would seem reasonable to assume that 
the contributions of the unmeasured factors were 
approximately equally distributed among the 
classes taught by these teachers. Such residual 
estimates were obtained for each class using 
both pretest and final class standings. S ince 
none of the measured pupil characteristics could 
be used for predicting pupil ваш, the gains them- 
Selves were used as measures of effectiveness, 
In some courses the gains were, however, ad- 


justed for difficulties associated with high pre- 
test scores, 


The standin 
eight criteria 


pupils, peers, teachers, an 
X criterion. А consid 
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of their pupils in tests of subject matter w d 
differences іп age, intelligence, average sch! 2 
astic standing, and pretest knowledge are zi 
tialed out and the evaluations based onp ко? 
gain in subject matter after the adjustment 
differences in initial score. 


Discussion and Implications 


The results of this study imply that the a 
uation of teachers is to some extent s anres 
by the choice of the criterion. Evaluation mus 
be made in terms of the criterion used = Эв 
as Ше rater, the situation, and other facto ets 

If a thorough knowledge of the «нас 
of the teacher is desired, the several иеден nt 
must be used. Ifallofthese criteriaare € h 
to have value, none correlated highly e ved s 
with the other to justify omission on the S terim. 
that they repeat the effects of the other criteri 
Presumably the validation of all criteria n 
in the finalanalysis, rest with the philosop 
adhered to. ion 

In some instances a composite evaluati € 
may seem desirable. To employ simple enm 
ages assumes that all components are equ very 
weighted, an assumption that probably geh 
questionable. Accordingly, some future ! tatis" 
Search must use factor analysis or other oris 
tical technique to properly weight the comp 
ents. again 

The present study assumed that pupil 8 cti- 
in subject matter was an important and pra В 
cal approach to criteria building. If such tha 
approach is used, it would seem advisable > re^ 
future studies be designed to investigate d gain 
lationship between subject matter gainan E 
in the more intangible aspects of the desir à 
concomitant learnings. Certainly there E in" 
need of developing more reliable and vali цал 
Struments for measurement of the concom 
learnings. re 

If pupil gains are to be used as a me еп 
teaching effectiveness, the tests must be Е ch 
under such conditions that the gains are mU This 
larger than the standard error of the tests. тест 
would require that the tests measure the о а 
tect of instruction and that the period ӨР 
test and retest be sufficiently long to рег ain$ 
large gains. A casual examination of the ем 
produced апа the standard errors as given | in^ 
the norms serves to advocate caution in the nile 
terpretation of gain scores as a criterion. гей” 
the tests employed in this study have high Г 
ability one may question whether they COV 
the objectives of the individual teachers _ 

Rating scales when used as criteria oa 
jectivity. If, for example, the same goun " 
Scale is used by two individuals, the согге s 
tions, although positive, are usually low: 1 of 
was amply demonstrated by the correlatio 


of 
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22 groups of pupil ratings and the peer 

Места ав used in this investigation. If teacher 

reliabi are to be used, this objectivity and the 
ability need to be improved. 

аг raters tend to overrate instructors 

for tha E rating scales. А study of the data 
the rating scales employed shows that the 


, med : 
ean rating places Wisconsin graduates consid- 


UR ме the mean for the teachers in par- 
ers шэг Schools. While those who train teach- 
Жане would prefer such an іліегрге- 
ego of i is more probable that it represents the 
he raters and also the amount of person- 


a А é 
„31 relationship between the rater and the ratee. 


of [кепил al, no adequate basis for validation 

is ap Cher evaluations existat present. There 

is и њи Ha general agreement as to what 

ent da. teaching, and even if there were, pres- 

for У measures lack the reliability necessary 
valid criteria. 
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TEMPERAMENT AND TEACHING SUCCESS 


HAROLD WESLEY MONTROSS* 
University of Wisconsin Extension 5 
Rhinelander, Wisconsin 


SECTION I 


INTRODUCTION 


APE 
acher сше problem in Ше field of 
Sonal qualiti ation is the determination of the per^ 
ing ies necessary for success in teach- 


їе: 


Ве mss 
tended 4. h in this area has been greatly ex- 
тарһу ог по years. Anannotated bibliog- 
Published манан competences lists 1006 studies 
а summar ince 1890 (15). Barr (4) has compiled 
ifically та 150 of these studies dealing ѕрес- 
eachin | the measurement and prediction of 
Up ee кд 
to show Piers the researchinthe field would seem 
thought im e teacher's personality is frequently 
Ing as ei ар: in relation to success inteach- 
found that yas 1910. Ruediger and Strayer (31) 
nificant ау was among Ше most sig- 
itty (43) а ities of the successful teachers. 
зи (3) analyzed some twelve thousand letters 
e desirabl pupils from all over the nation. 
requently s teacher traits mentioned most 
titude; ( Mrd (1) cooperative democratic at- 
idual: (3) iness and consideration for the 
5 (5) ха. patience; (4) wide variety of inter- 
ner, eral appearance and pleasing тап” 


Altho 
ic Ation "od research in the field of teacher ed- 
15 an ise Seem to indicate that personality 
identification variable in teaching success, the 
Not been шон and definition of this variable has 
his 5 

ot personality is concerned with those aspects 
с Port (1) | y sometimes called temperament. 
ki in Pia characterized temperament ав а 
ag ality is fa of raw material from which рег. 
4 Ше “cons Shioned. Cattell (10) describes it 

escri ing istitutional factors” in personality, 
ын ОГ the constitutional” as referring to that 
piblect to ем | which, at any аве, 15 least 
as Нопаг але. Harriman (20) in The New 
Ё Psychology, defines temperament 


The 

tern p de or less stable effective ра!” 
is reye acteristic of an individual. 
стон 19 by one's susceptibility to 

Ју ace Stimulation, by reactiontime, 
intensi ngth of responses, БУ quality and 
aitensity of moods and by all that is sub” 


Temperament is used to designate the more 
or less stable dispositions that are relatively 
permanent and evidenced at an early age. The 
earliest adjustments which can be distinguished 
nd which show differences are in the 


in infants а. 
areas of spontaneous activity and emotional ех- 
pression, —both temperamental traits. Re- 


search indicates that these characteristics of 
early childhood tend to persist (1). 

Although temperament might be said to des- 
ignate a kind of raw material from which рег- 
sonality is fashioned, it probably cannot ассиг- 
ately be said that temperament exists apart 
from personality, nor 18 there any personality 
which is devoid of temperament. 

The area of temperament would seem to be 
one of the logical starting points for a study of 
the personal prerequisites to teaching success. 


This would appear SO inasmuch as: (1) traits 
rly age; (2) traits are rel- 


are evidenced at an ea 
atively persistent and stable; (3) traitsare said 
to be the raw material from which personality 

is fashioned. This investigation is concerned 

with certain aspects of temperament and their 

relationship to teaching success. 


SECTION П 
DESIGN OF THE STUDY 


Description of the Subjects 


TWO HUNDRED seventy-nine students 
in the School of Education at the University of 
Wisconsin secured teaching positions in second- 
ary schools of Wisconsin in the fall of 1950. One 
hundred one of this group Were visited under the 
beginning teachers visitation program of the Un- 
iversity. From this group thirty-five were will- 
ing and available to participate in further inten- 
sive testing which constituted a part of this in- 


vestigation. 

The thirty-five subjects of this investigation 
consisted of sixteen male and nineteen female 
teachers majoring in the areas of English, math- 
ematics, physical education, speech, science 
art, music, social science, and home econom- 


ics. 

Each individual of this group had completed 
a four-year course at the University of Wiscon- 
sin and had taught at least one year in the sec- 
ondary schools ох Wisconsin. 


me 
*The Ч under ‘emotional nature". 
appreciation 


зе 
Rcouragement, and inspira 


ance “ОВОР wi = 1 
T wishes to nis to his major professor, Dre А. 5 _ 
9) жө mm Barr, f É 
express tion throughout the scudys ° » for his guid- 
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Table I presents a comparison between the 
subjects of this investigation and the subjects in 
a study by Lins (28). Cómparisons are made in 
the following areas: the mean grade point aver- 
age in Education 73, Education 74, Education 
15 practice teaching (required courses in Edu- 
cation at the University of Wisconsin), the total 
four year grade point average, and the mean 
percentile rank on the American Council on Ed- 
ucation Psychological Examination. 

The subjects of this investigation seem not 
to be greatly different from other groups stud- 
ied at the University of Wisconsin. 


Description of Data-Gathering Devices 


А major purpose of the investigation was to 
study the relationship between certain aspects 
of temperament and teaching success. Temper- 
ament was measured by the Thurstone Temper- 
ament Schedule, Cattell's 16 Personality Fac- 
tor Test, and a series of objective type tests 
of tempo, fluency, Speed, Suggestibility, dispo- 
Sition rigidity, and dexterity— coordination. 


1. The Thurstone Temperament Schedule 
(Appendix В):* T 
Signed to assess 


ly permanent for each individual. Thetestwas 


dy with three 
personality 
ntiating between 
well adjusted 

r resulting from 
Thurstone found that 


а) Active (A). A person Scoring high in this 
агеа usually works and moves rapidly. He 
1s restless whenever he has to be quiet. He 
likes to be “оп the go” and tends to hur гу 
Бре Speaks, walks, writes, drives ` 

TKS rapi iviti 
ee кра тен when these activities 


b 


< 
= 
о 
"n 
8 
n 
= 
3 
> 


с) Impulsi 
i dicate a Шин 71 іп this category іп- 
Hoting-on- бавна И, daredevil, carefree, 
tion. The person makes e-moment disposi- 


High scores 


(Vol. XXIII 


enjoys competition, and changes easily from 
one task to another. The decision to act or 
change is quick regardless of whether сар" 
person moves slowly ог rapidly (Active); ore 
enjoys or dislikes strenuous projects (Vig 
ous). 


d 


= 


Dominant (D). People scoring high on this. 
factor think of themselves as leaders, сея 
able of taking initiative and ди ЕН 
They аге not domineering, even though im 
have leadership ability. They enjoy pu 1 
Speaking, or organizing social ВОИ, а, 
promoting new projects and persuading 0 


e 


— 


Stable (E for emotionally stable). Uy 
who have high Stable scores usua lly ак 
cheerful and have an even disposition. ain 
can relax in a noisy room, and they rem өті 
calm ina crisis. They claim that hey rt 
disregard distractions while studying. T^. 
are not irritated if interrupted when con 
trating, and they do not fret about daily 
chores, 


1) Sociable (6). Persons with high scores їй 
this area enjoy the company of others, ea r“ 
friends easily, and are sympathetic, CO it 
ative, and agreeable in their relations W 
people. 


— 


6) Reflective (В). High scores in this are сен 
dicate that a person likes meditative s theo" 
flective thinking and enjoys dealing vit - 
retical rather than practical problem? va 
examination is characteristic of reflec jet, 
persons. These people are usually е с“ 
Work alone, and enjoy work that requir 
сигасу and fine detail. к 
: 10 
The Schedule was designed to рг ovide Чт пе 
Survey of the seven areas of temperamen ед 
reliabilities for the seven areas in Ше Цан ру 
were computed by the split-half method pe are 
the test-retest method, These reliabilitie 
summarized in Tables П and Ш. e sul 
The tests were administered during th the 
mer and fall of 1951 at the convenience 0 an 
subjects. Standard directions were Да а neo” 
the subjects were allowed as much time 2 
essary to complete the test. ay Test, 
IL The Cattell 16 Factor Personality nays? 
(Appendix С): On the basis of factorial 2 eet 
Cattell has designed a questionnaire БУР | pce 
which sets out to Шу” 1 


traits which he feels provide the fundamer 


st 
Structure of personality. The 16 РЕ. T° 
> А 


15 
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COMPARISON ОҒ THE MEAN GRADE POINT AVERAGE IN EDUCATION 
АТ, FOUR YEAR GRADE POINT 


73, 74, 15 PRACTICE TEACHING, TOT. 
AVERAGE, AND MEAN PERCENTILE RANK ON THE AMERICAN COUN- 
CIL ON EDUCATION PSYCHOLOGICAL EXAMINATION WITH THE SUB- 


ТЕСТ$ IN A STUDY BY LINS 
Mean 
) Measure 15 2? 
Education 73 2.31 2.34 
| Education 74 2.13 2.02 
Education 75, Practice Teaching 2.37 2.17 
| Total Four Year Grade Point Average 1.93 1.88 
American Council on Education Psycho- 
65. 63 54. 453 


| 
logical Examination 


ISubjects of this investigation 
\ ?Subjects in а study by Lins 
| 3 Adjusted mean for men and women 


TABLE II 


IABILITY COEFFICIENTS FOR THE 


- L 
SPLIT-HALF RE Е EMPERAMENT 


SEVEN AREAS OF 


о | 


Women 
Area Men o 
.46 
Active и E . 63 
Vigorous “65 “65 
Impulsive “41 A 
Dominant š 63 .64 
Stable .68 „73 
Sociable ‚ 3 . 62 
Reflective 
200 157 
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TABLE III 


TEST-RETEST RELIABILITY COEFFICIENTS FOR 
THE SEVEN AREAS OF TEMPERAMENT 


Area Correlation 


Active „18 

Vigorous „78 

Impulsive .19 

Dominant .82 

Stable .61 

Sociable . 73 

Reflective 419 

F == = ————————— 
N 81 

ХЭВЭЭР Эхэ ээтэн эрэгчин 

TABLE IV 


SPLIT-HALF RELIABILITY COEFFICIENTS FOR 
THE 16 P.F. TEST 


Correlation 
=== MaÀ———M MM НИЙ, 
.84 
„70 
«ПИ. 

„82 
. 85 
.56 
. 74 
.54 
. 55 
„та 
. 65 
. 88 
- 50 
. 61 
«58 

76 


ооох г=щот=тшош> 


“ 


ор 


ее... 200 
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ee 
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wa: 

е аѕап assessment of the total personal- 

сан ав ап indicator of temperamental factors. 
ell says of the test: 


цан яивнцавшинв thus aims to leave out 
alit > aspect of Ше total person- 
па or the above factors are based on 
and аге the personality sphere 
Вале юэ abilities (intelligence), tem- 
{ет int ntal factors, and dynamic (charac- 
integration) source traits. (7) 


а тезше has equivalent А and B 
ride e in length and design. Both forms 
Were шал three hundred seventy-four items 
Sible respe Each item is followed by the pos- 
Cattell ^ eds of “Yes”, “2”, and “Ко”. 
Wer with рока: the ‘‘forced choice” ans" 
nden ceras elimination of the 5?” response 
the “for rtain conditions. In this investigation 
tests Ж choice” response was used. The 
Convenienc administered to the subjects at their 
ach Чаты in the summer and fall of 1951. 
еввагу юэ. was allowed ав much time аз пес” 
js cantata bolh-fartss of the test. 
Sample of it-half reliability of the test on 2 
the full the general population, corrected to 
umma number of items in A and B forms 18 
rized in Table IV. 
Perament U Objective Type Measures of Tem- 
Which qut (Appendix D): It was felt that tests 
might mee no subjective self-evaluation 
атыш St appropriate in fhis field The 
Most full for the use of such tests has been 
Sented ШУ developed by Cattell (9). Не has рге- 
üreg» e which he terms ‘objective meas" 
in tem t are thought to indicate ог assess сег- 
other w Peramental factors. Out of this, and 
The ров, tests were devised and adopted. 
bility red of tempo, fluency, speed, suggesti- 
ination wee rigidity, and dexterity-coore” 
res were S investigated. At least two meas" 
Suggestibi Obtained from each area except for 
ibility where only one measure ав used. 


Тһе 
Quir attery of objective type measures re- 


for 


int te 
of the Po ridi d fall of 1951 at the convenience 
te of Objective Туре Instruments 

: Tempo 


Te 
m i 1 + А 
ñatural 227 in this investigation, EHE. eie 


г preferred rate of speed in = 


Ап 
Kohle, "ber of writers, among the 
ate » Guttman, Meumann, and Wu have ^. 
velop Search in the area of tempo d have 
Ред theories of temperament on the basis 
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of the existence of general personal tempo. 
The most extensive work in the ‘study of tempo 
itself has been done by Allport and Vernon (2) 
and by Harrison (21). Allport and Vernon stud- 
ied fourteen varied natural tempo rates. They 
were unable to show the existence of a general 
preferred rate or speed, finding an average in- 
tercorrelation between the fourteen rates stud- 
ied of .17. Harrison also was unable to find a 
single general factor of tempo. Cattell (7) has 
postulated that tempo can be clustered into the 
following areas: (a) ideomotor tempo, evidenced 
through such activities as the normal rate of 
reading, counting, handwriting, tapping, and 
blackboard writing; (b) rhythm tempo evidenced 
through such activities as the normal rate of 
finger and hand tapping, leg tapping, patting, 
counting and stylus compression; (c) drawing 
tempo, evidenced through such activities as the 
normal rate of drawing figures on paper, foot 
lackboard drawing; (d) general 


drawing and b. 
tempo, evidenced through such activities as the 


normal rate of cranking, tapping, body bending, 
patting, speed decision, and card sorting; (e) 
body tempo, evidenced through such activities 
as the normal rate of head turning, body bend- 
ing and arm raising; and (f) limb tempo, evi- 


denced through such activities аз the normal 
г and walking. 


rate of arm raisin 1 
Тһе ехіѕіепсе and the possible temperament- ' 


alorigin of personal tempos seems to be fairly 
ished in the literature. 

ures of tempo, used in this in- 
vestigation, were designed to cover the areas 
d general tempo. The tests 


of ideomotor ап а 
themselves аге adaptations of measures gener- 


ally used in this area. 

Subtest 1a: Subject read a mimeo- 
graphed paragraph of American his- 
tory. Subject was told in all tempo 
tests that time was not а factor in the 
test, but time was unobtrusively taken 
by tester. 


Score: Time of reading in seconds 


Subtest 1b: Subject wrote two lines of 
the paragraph used in subtest 1a. Time 
recorded 45 in subtest 1a. 


Score: Time of writing in seconds 


Subtest 1c: Subject counted orally to 
the nuniber forty. Time recorded as 
in subtest 1a. 


Score: Time in seconds 


Subtest 1d: Subject sorted cards used 
іп subtest 3b. Time recorded as in 


. 
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subtest 1a. 
Score: Time in seconds 


Subtest 1e: Subject tapped on tapping in- 
Strument used in subtest 3a. Time re- 
corded as in subtest 1a. 


Score: Number of taps in thirty seconds 


Subtest 14: Subject was asked to select 
Írom twelve cards face downward on a 
table, the three cards which he feltwere 
the highest of the twelve. On second 
trial subject was asked to select the 
three cards which he felt were the low- 
est from another set of twelve car ds 
placed in the same position on the table. 
Time recorded as in subtest la. 


Score: Average time, in Seconds, of 
two trials 


Test 2: Fluency 


Fluency of association, 
taneous calling to mind of ideas, has been shown 
to exist as a distinct factor. Carroll (5) and 
Johnson (23), ina factoring of verbal abilities, 
5oth found a factor characterized by the ready, 
Spontaneous flow of ideas, words or ima ges. 
Cattell (7) suggests the presence of at least four 
distinct kinds of fluency: (a) fluency of associ- 
ation under restriction evidenced through such 
activities as giving as many words as possible, 
under time limits, beginning with a certain let- 
ter; (b) fluency of association with minimum di- 


rection evidenced through such activities as 
number of words per minut 


or topic or number of rele 
describing а picture; (c) ғ 


referring to the spon- 


imum speed of 
It may be noted that Cattell 
‚ ша makes а shar 
erre a between fluency ава temperamental 
rait and its associati i ili 
[iere Оп with an ability factor. 


reading, 


(Vol, ХХШ 


с і 15 
Three measures of Пшепсу were -— en 
investigation. Two of them were pcr dnm 
assess fluency of association under ще БЕ un 
The remaining measure was felt to ан 
ency of association under minimum dir 


Subtest 2a: Subject was asked to record 
on a numbered sheet of paper as m РА 
adjectives that he could think of w ped 
could be used to describe a house. 

limit four minutes. 


Score: Number of relevant words re^ 
corded 


Subtest 20: Subject was asked to record 
on a numbered sheet of paper as x4 

things that he could think of which Le 

‘round’ or that are called round. 

limit four minutes. 


Score: Number of relevant words re^ 
corded 


Subtest 2c: Subject was asked to гавра 
on a numbered sheet of paper as та A 
words that he could think of which begin 
with the letter B. Time limit four m 
utes. 


Score: Number of relevant words ге“ 
corded 


Test 3: Speed 


d 
зрее 
Speed in this investigation refers to Pere all 
of repetitive or selective performance ^e of 4 
of the content is perceptually given. pout зрее” 
the concern in the literature centers ев. 4 
аз а general ог specific factor in ын іһеге 
rison's work (21) seems to indicate ын speed: 
is no single general factor of maximun uch 25: 
He studied a number of performances Sunting 
card sorting, tapping, head turning, the m 5 
reading, making decisions and found пшр 
intercorrelations to be about . 15. jene has Du 
of different types of speed performance, re йн 
рееп determined with respect to presen prese? 
Cattell (9) feels, though, that from the дж 
research we can assume the existence па 1960 г; 
Speed factors: (a) speed of judgment а зоп ій? 
motor performances; (b) speed of rea imal oi 
(c) speed of bodily movement; (d) mas КП ап” o; 
thm; (e) fluency ог speed of mental ou га. tem? 
association; (f) various factors of pant ог 
and (5) perceptual speed. Тһе sola eter mi, 
Speed and temperament has not been 1 positi” g 
ed although Cattell suggests a genera = ае, 
Correlation. It has been further SUBEO the 
the significance for temperament lies 


^ 


у 


Septemb 
er, 1954) MONTROSS 


ter-r i ; 

mm. DN between speed, tempo and flu- 

es S Porren ig of Studman (36), for ex- 

Speed EA that the difference between 

iMm C luency seems to be of special signif- 

this im attell points out their significance for 
vestigation as follows: 


Т : 

аи | жек interest of these speed, tempo, 

justice 4 factors for personality, which 

histor abi the somewhat detailed study of 
ability roots here, is that they are 


amon : die 
пе аи direct indicators of temp- 


| " 
e in this area were selected to Se- 
Speed fact ures from the first two of Cattell’s 
time рсы. i those of ideomotor and reaction 
under willed These factors represent speed 
tempo and fl action which is distinguished from 
investigation. by the definitions used in this 

on. 


840 
пина = Subject tapped on tapping in- 
metal = The apparatus consisted of а 
ен: Ни te wired to an electrical count- 
teehee рэн: pencil was held in 
tap of fee s dominant hand. With each 
plate dee pencil, contact with the metal 
Subject iege the electrical counter. 
Sible for thi asked to tap as fast ав ров” 
ings wer irty seconds. Four testread- 
Second е taken, There was à thirty 
rest period between each test. 


Score: 
те: Average of four readings 


* Su 
w pis: Subject was told to sort a 
ed area, enty-four cards into six label- 

ered a The set of cards were num- 
was b om two to seven and sorting 
ings east only. Four test геа4- 
жеге an taken. The labeled areas 
minimi nged on each test in order to 
і ize the factor of learning. Sub- 


Ject ху; = 
А ии to go as rapidly as 


Sco 

re: š š 

е: Average time in seconds of four 
readings 


s 
eee Зе: Subject was checked onforty 
Tegula ls ina visual series with an ir 
sisal y spaced interval of warning. The 
ег Бер used was ‘ready’, given by the test- 
tice ore flashing an amber light spaced 
i between two keys, one of which 
Subjec be depressed to stop the timer. 
veni ct used dominant hand and most con- 
actio, nt key during the test. Twenty ге“ 
Sug, ns were taken; then the Body Sway 
Sestibility Test was interjected be~ 


fore checking the final twenty reactions. 
Timing was in hundredths of a second. 


Score: Median reading 


Subtest 3d: This test is takon from the 
Wechsler Test of Mental Ability (41). 
Subject was asked to write beneath a 
series of numbers an arbitrarily а5- 
signed symbol of each number, Time 
one minute. Subject was asked to go 
as rapidly as possible. 


Score: Number of digits with correct 
symbol 


Test 4: Suggestibility 


Many writers have investigated suggestibil- 
. Among them McDougall, Morgan, Allport, 
Hull and Eysenck. Eysenck (16) has perhaps 
presented the most complete investigation of 
the trait. Out of his factorization of sixteen al- 
together different tests of suggestibility he post- 
ulates the existence of two and possibly three 
Í suggestibility. These he terms 
‘primary suggestibility, › ‘secondary suggesti- 
bility, ’ and ‘prestige suggestibility. ы 

Eysenck further investigate the personality 
correlates of primary suggestibility іп analyz- 
ing the scores of one 
fifty subjects. 
ships between his primary S 
traits considered in this inve 


temperamental origin. Ет 
A well-known measure of suggestibility, and 


one used by Eysenck, i$ the Body Sway Te st. 
It was used in this investigation. 


ity 


stigation to be of 


Subtest 4a: Subject was blindfolded. To 

his collar was clipped а string whichran 

through а pulley taped to the wallandwas 
г which could move 


along an upright yardstick, 
d to the wall. Subject was 


recordings. 


hibit or acce 
ment, butto try to relax andlisten, The 


forward and backward sway of the sub- 
ject was then measured on a 1/4 inch 
sway of the individual. 


One minute—the natural sway of the in- 
dividual. 


One-half minute—the sway while the sub- 
ject listened to the voice recording of 
“You are slowly falling forward, slowly 
falling forward; you are slowly falling 
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forward, falling forward, falling forward, 
falling, falling. " Repeat. 


One-half minute—the sway while the subject 
listened to the voice recording of “You are 
slowly falling backward, slowly falling back- 
ward; you are slowly falling backward, fall- 
ing backward, falling backward, falling, fall- 
ing." Repeat. 


Score: Forward and backward Sway of the 
subject was recorded in inches to the near- 
est 1/4 inch, positive when it agreed with 
the direction suggested by the recording, 
negative when opposed action was shown. 


Test 5: Disposition Rigidity 


In normal individual behavior it often happens 
that an old reaction will persist when a new one 
is intended. In extreme cases, as in the schiz- 
орһгепіс, the individual may sit for long periods 


of time repeating the same movements or words. 
This behavior 


by most of the 
tell (9) in a recent extensive review of the data 
has postulated 
tion of perseveration is as disposition rigidity. 
In agreement with Cattell this investigation con- 
Siders disposition rigidity to refer to the гез15- 
tance of уШеа change of old established habits. 
It is best measured by tests in which the individ- 
ual tries to perform an old task in a new way. 
For example, it could be measured by the num- 
ber of times the subject could write hi 


repeat itself w 
ciated with temperament, 


rigidity is one of 
erament, 
The measures 9f disposition rigidity in th; 
| 2 gidity in this 
дере а are taken from a battery of tes ts 
y Cattell (11 for t| 
this rigidity trait, ч 4 


Subtest 5a: Subject w; 
limits, to Write the dio; 
Time one minute, Sup; 

i ninute, ject was asked 
write the digits 2, 8, 7, (У) dinem 
both in direction and 


Score: Number of digits wri 


number of digits written X Tu in X, over 


Subtest 5b: Subject чад asked, under time 


(Vol. ХХШ 


ime 
limits, to write the symbol L О, Eu 
thirty seconds. Subject was аз ын еу 
der time limits, to write the m ША 
(Y) Time thirty seconds. Subj "€ T 
asked, under time limits, to 2 жил 
twosymbols (Z)alternately. Тіп 
one minute. 


i d 
Score: Total number of symbols in ro 
Y, over total number of symbols in 2. 


Subtest 5c; Subject was asked to хане 
through а maze (X) laid out in bloc 
comparable to a city street = жете е 
Letters in Ше maze paths indicated бай 
direction subject was to go. Р appe ht 
down, L indicated left, R indicated "| 
and U indicated up. Time one durer simi 
Subject was asked to trace throug ubject 
ilar second maze (У). In maze Ys г 
was asked to до Ше direct opposite 1 
what the letters in Ше paths suggested. 
Time was two minutes. 


151015 
Score: Total number of correct ih 
made in X over total number of co 
decisions made in Y. 


Test 6: Dexterity— Coordination 


The significance or temperamental 1 
tions of dexterity— coordination is no 
as in the other objective test measur oad in 
Senck (16) finds finger dexterity ger 
individuals of certain temperamental ome 8015, 
Cattell (10) has found what he terms Semper” 
of psychomotor efficiency, related to cerne 
ment. Schwartz (35), although not con nificant 
with temperament directly, found а nor in^ 
correlation (-. 60) between a two han Ё 
ation test and field teaching. relatio? 

On the strength of these suggested tigation: 
Ships two tests were used in this EE were 
Both are adaptations by the author whi ог this 


Ї 
felt could give the desired assessment 
area, 


„аг 
mplic 
5 clear 


as 
Subtest ба: Instrument in Subtest чү р” 
шей, Rather than tap on metal plate 5. 
Ject was asked to put tapping раи F 
nately into three holes placed in wem 
Шаг arrangement on the metal Pa on 
When tapping pencil touched the БО аз ас” 
Of the hole the electrical counter Мес 
tivated. Time thirty seconds. sible. 
Каз asked to go as rapidly as p эрэ? right 
Four trials were given, two with lef 
Ог dominant hand and two with the 
non-dominant hand. 


e 
Score: Difference between the avera£ 


ч 
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п 
umber of taps of right and left hand. 


Subt 5 

into s. А sheet of paper was blocked off 

in each jab gen squares. Witha pencil 

Simulta nd subject was asked to mark 
neously a straight line and across 


within 
Меры ин square successively for thirty 


Score: 
mae of squares filled with both 


Iv. я 
Ching Ж... Criteria of Teaching Success: Tea- 
fa) the "m in this investigation, refers to 
Cipal or su ptability of the teacher by the prin- 
caching ИД z intendent; and (b) it refers to 
defined on eect as that effectiveness is 

nk, (8 he Wisconsin. Adaptation of the М- 

» (бее Appendix А.) 


Description of Ratings 


Rati 
ing 1: Acceptabilit 


A rati 
(26) fant termed “acceptability” by Lamke 
© obtain t pn investigation, was obtained. 
With the teal rating an interview was conducted 
In which уран principal ог superintendent, 
following ring the course of the interview, the 
ng questions were asked: 


1. в 
(9) 

3, Я e like this teacher? 

3 get along well with students? 


the 
parents feel the same way as the stud- 


* Is thi 
+3 the teacher happy here? Does he have : 
ап 


сл 


n ter 
ms of beginning teachers with whom you 


ve 
ura кеа in the past, and in the light of 
ussion as a whole, would you consid- 


ns ask- 
the 


Out of hi 
84, the f his consideration of the questio 


teacher Principal gave an overall rating of 


Rati 

ng 2: pri | 
а: Principal ог Su erintendent’s Effic- 
1епсу Rati 


Тһ я 
Pal or gating was given by the 
tation o ; Derintendent using the 
nt of Ве M-Blank as a guide for 
e teacher's effectiveness. 


Rating 3, 


teacher's princi- 
Wisconsin adap- 
the а55е55- 


Experienced Rater 1 
Еа 
Ch subject was visited in his classroom by 
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two experienced raters. A group of six grad- 
uate students, trained for the visitation pro- 
gram, formed what was termed the coregroup. 
The remaining raters were staff members of 
the University of Wisconsin. On each visita- 
tion at least one of the core group was included.. 
This core group was labeled experienced rater 


L 

Independent ratings Were made of the teach- 
er's effectiveness using the Wisconsin adapta- 
tion of the M-Blank as а guide. 


Rating 4: Experienced Rater II 


This rating was obtained under the same 
conditions as rating number 3 and was given by 
the staff members of the University of Wiscon- 
sin. 

These four ratings Were obtained in the tea- 
cher's fírst year of teaching and after he had 
been teaching for at least three months. 


Rating 5: Principal or Superintendent's Effic- 
iency Rating in Second Year of Теасһ- 


ing 


An abbreviate 
Wisconsin adapta 


d form (Appendix A) of the 
tion of the M-Blank was used 
for this rating. It was obtained in the subjects’ 
second year of teaching, at least three months 
after the beginning of the school year. 


Reliability and Validity of Objective Measures 
of Temperament 
Cronbach (14) suggests the consideration of 
f reliability coefficients, that of 
coefficients of equivalence, stability, and sta- 
bility and equivalence. The equivalence aspects 
of reliability estimates how precisely the test 
ual sample of behavior at 


measures an individ 
a particular time. It can be determined by the 


split-halí method, by the Kuder-Richardson 
formula, or by immediate parallel testing. The 
stability aspect estimates whether or not a be- 
havior at the time of testing is typical behavior 
at any other time. The stability of a behavior 
can be estimated by the retest method. Tue 
stability and equivalence aspects of reliability 
gives an estimate of change over a period of 
time and the fluctuations between two supposed- 
ly equivalent tests. The use of a particular type 
of reliability estimate would depend upon the 
situation. Inthe objective measures of temper- 
ament the primary interest is in whether or not 
the particular behavior sampled at the time of 
testing is typical of that same behavior at some 
later time. This would mean that the coeffic- 
ient of stability obtained by а retest after а 
lapse 2 ише would be considered.” It did not 
сееш feasible, at the time i 
this reliability estimate. ань CS 
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TABLE V 
INTERCORRELATIONS OF CRITERIA RATINGS 
" (К = 34) 
Согге1айоп 
4 
Rating b 2 3 
Principal's Acceptability ..й. 
Principal's M-Blank . 93 sassa 
Rater Number 1 .12 .55 ... 
Rater Number 2 .64 „57 „73 . ah 
Principal's M-Blank 2 .50 «53 ‚39 - 
ТАВГЕ УІ 


RELATIONSHIP BETWEEN THE FOUR RATINGS IN СОМ- 
POSITE ONE AND THE FIRST GENERAL FACTOR 


TM 


General Factor 
Rating 


Loading 
Principal's Acceptability .94 
Principal's M-Blank .87 я 
Rater 1 .85 
Rater 2 .84 


ns 


TABLE УП 


RELATIONSHIP BETWEEN THE FIVE RATINGS IN COMPOSITE 
TWO AND THE FIRST GENERAL FACTOR 


a 


ва General Factor 
ating Loading 
Principals Acceptabili: 

Principal’s M-Blank ч 87 

Rater 1 я 

Rater 2 1 
Principals M-Blank 2 68 


September, 1954) 


Ап Я а 
in the jose reliability estimates canbe found 
classificati ure which fall under the ge neral 
number of гэн of mechanical and motor tests. А 
in this iny ese tests are of the sametype used 
ҮЗЛЕ 
retest а for example, reports the 
,:90 When ei ility of reaction time as beingabout 
test for Ё ünder the same conditions as Ше 
Greene Тусе time in this investigation. 
With a s reports on the use of a tapping test 
Several UE. retest correlation of about .91. 
Scribed by =. of motor tests аге further de- 
tests of the зер These batteries include 540- 
Jective indi ind used in this investigationas ob- 
for беке эрсэн of temperament. One ofthese, 
8 reported the Stanford Motor Skills Tests (18) 
Ог each it retest reliabilities of . 75 to .86 
Resear i in the battery. 
ency, шон studies in Ше areas of tempo, flu- 
ОЧЕНЬ and disposition rigidity are 
ot mechanical a; as are the studies in the area 
у, гена and motor abilities. Subsequent- 
ten, ility estimates are not reported as of- 


Per 
een ma the most comprehensive study has 
егпоп (2) n the area of tempo by Allport and 
ону сх, ЗАО ев. reliabilities, 
RE өгөн tirer d of speed with a single task 
Counting, а а in such areas as reading, 
қ AleSbeetively. 16 to be . 88, . 85, and 
, Altho ae 
high in ИЯ estimates are reasonably 
lon in this erature, any subsequent investiga- 
bilities of тресе establish the retest relia~ 
ment, he objective measures of tempera" 
A test is са; 

Jat it kt заза to be valid when it measure? 
this vont: orts to measure. The tests usedin 
ent pur igation as measures of tempera” 
ment, TEM to be valid indicators of tempera” 
Aside fne conclusions may be questioned, but 
dicators P a validity as temperamental іп” 

it is Чең еїг relationship to teaching success 
$y may - in this investigation, whatever 
e measuring, is of interest. 


Reli я 
abili 
ility and Validity of Ratings 


No reliabili 
used in ты estimates of the five rating? 
Correlati e criterion were obtained. The inter- 
Seen in ions of these criterion ratings сап be 
As able у. 
апа the DT Айына the Principals А 
tx lation "a ap M-Blank rating show 
n the 93. These two ratings were ob- 
па e first year of teaching at different 
Same ae h different instruments, & i 
ividual giving both ratings. 


Teas 
Опа 
ment 22 to assume that had the 52: 


Ability е 


cceptability 
a cor- 


me instru 


n used in both ratings that such а reli- 
Stimate would have been higher than 
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the .93 correlation. Rater one and two, using 
the same instrument at the same time, согге!- 
ated „73. It сап be seen that the г elationship 
between rater one and rater two, and the rela- 
tionship between the Principal's Acceptabil- 
ity and the Principal’s M-Blank zating, is great- 
er than the relationship of the two principals' 
ratings with either of the ratings one and two. 
The Principal's M-Blank rating num ber 
two which was obtained in the second year of 
ifferent instrument, and with 
nthe Principal's Acceptabil- 
ity and the principal's M-Blank rating, shows а 
relationship with the Principal's M-Blank and 
Ргіпсіра175 Accepta 
tively. Itis not known, though, whether the 
change in rating is the result of a different opin- 
ion expressed by the individual giving the 
ge in the individual being rated 


rating, руа chani 
or because of a difference in instruments. 


Treatment of the Data 
es of the objective measures 
of the Thurstone Temperament 
of the Cattell 16 P. Е. Test 
were used in all calculations. The rating scores 
were treated as com posites. Intercorrela- 
tions between the various criterion scores are 
given in Table V. Two composite scores were 
constructed. The first was a $ ummation of 
the four ratings obtained in the subjects first 
year of teaching: the Principal's Acceptability 
rating, the principal’s M-Blank rating, Rater 

1 апд 2. The se cond composite was construct- 
ed around a fewer number 01 cases inasmuch as 
in the second year of teaching nine subjects were 
no longer teaching. ]t consisted of the four rat- 
ings which composed composite one plus the ad- 
dition of а second Princ ipal's M-Blank rat- 
ing. The criterion scores, hereafter, will be 
referred to 25 composite one and composite 
two. 

Further relationships between the individual 
ratings are given in Tables VI and VII. 

Since the correlations between the individual 
ratings and the general factor are all rela- 
tively high the ratings can essentially be 
considered а5 measuring the same thing. 

Throughout the study the Pearson Pro- 
duct Moment Coefficient of Correlationhas been 
employed to determine the a mount of relation- 
ship between measures oft 
the criteria. ëmperament and 

To determine the lev : Бр 
of a coefficient of шэг. B cance 
(27) were used. The tables give signifi indquist 
the five and one percent levels for icance at 
various size. samples of 


The raw scor 
of temperament, 
Schedule, and 
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TABLE VIII 


CORRELATIONS BETWEEN THURSTONE TEMPERAMENT 
SCHEDULE AND COMPOSITE ONE AND TWO 


Temperament Composite Composite 
Trait No. 1 No. 2 
A ‚01 ‚05 
y -.23 -.29 
I -. 05 -.10 
D .26 „14 
Е -.03 -.08 
8 ‚05 -.16 
R . 03 „17 


TABLE IX 


CORRELATIONS BETWEEN THE CATTELL 16 P.F. TEST 
AND COMPOSITE ONE AND TWO 


ад ———  - 


: Composite Composite 
= ‚21 ‚40 
С “А . 18 
Е .26 .20 
F . 03 .10 
G 3,101 . 10 
Н =421 -. 11 
1 7.15 . 02 
L 421, 114 
м . 06 =, 11 
М ~. 12 =. 01 
о .14 .30 
Q, -.01 -.01 
Q, .21 ‚32 
СЕ = А . 00 
Q, T. 02 =. 08 


-. 03 . 06 
а ааа 


35 25 


| 
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TABLE X 


—Á BETWEEN THE OBJECTIVE MEASURES OF 
PERAMENT AND COMPOSITE ONE AND TWO 


Correlation* 

Tempo Reading 
Tempo Writing š ~ © 
Tempo Counting . 06 “93 
Tempo Tapping 210 “14 
Tempo Card Sorting . 06 ( 31 
Speed of Decision . 05 “00 
Speed Tapping 145 “41 
Speed Card Sorting . 08 226 
Digit Symbol am 36 
Reaction Time 212 „11 
Fluency (Adjectives) „41 .28 
Fluency (Things Round) . 09 . 03 
Fluency (First Letter) .29 „21 
Туо Напа Coordination „13 ‚21 
Right and Left Hand Coordination .57 „41 
Sway (Total Amount) .02 .20 
Disposition Ri gidity (Subtest Ба) „07 214 
Disposition Rigidity (Subtest 55) .20 .19 
„11 . 08 


ашу (Subtest 5с) 


Disposition Rigi 
N 34 26 
dicate positive relationship 


ЖАЦ signs changed to in 


TABLE XI 
TWEEN COMBINATT 


CORRELATIONS BE 
THE OBJECTIVE MEASURES ОЕ TEMPER 
COMPOSITE ONE AND TW 


Correlation* 
Composite 


ONS AND PARTS OF 
AMENT AND 


Composite 
No. 2 
Measure No. 1 
Maze Number 1 (Subtest 5c) 42 ‚36 
Deviation of Reaction Time 
from Median in positive Р” "m 
to indicate positive relationship. 


ЖАЦ signs changed 
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; SECTION Ш 


ANALYSIS OF THE DATA 


Correlations Between Thurstone Temperament 
Schedule and Composite One and Two 


Correlations Between the Cattell 16р. Е. Test 
and Composite One and Two 


f Speed of Tapping (. 45), 
Coordination -57), and 
Fluency ( 41), with co i a 


ite one, Th 
and compos 
less, 


Correlations Between Combinations and Parts 
of the Objective Measures of Temperament 
and Com OSite One and Two 


In Section Il it was S 

| gested that the ion- 
ship between Severa] ais објесну — 
might be Significant in 
erament. As, for 
tween Speed, te ‚ апа 
temperamental indicat i i 
Several combinations к = 2 Sei ПЕ — 


measures 
ded statist; тете made, 


example 


i tically signific B 
relations Se ar sented in a D т сог 
Тре naw Scores ор these mean 1. 
ed in Table хтх, ur 


es аге Present- 
These Correlations аге consis 


tent for both 


d 
composites, except for Maze Number 1 an 
composite two, where r = . 36. 


: А + nif- 
Intercorrelations of Objective Measures Signif- 


icantly Correlated with Criteria 


From an inspection of Tables X and а 
may be seen that five of the objective vete a 
оі temperament show а Significant relati is 
with the criteria, that is, if one is vie dw 
look upon the group here studied as etm 3 
drawn, which Strictly speaking, it is not. 


: in 
Summary of these measures is presented i 
Table XII. 


The intercorrelations for the five на а 
measures showing а Significant шин нэ 
with the criteria were computed separate y їп 
each composite, since the number of case 
each differ, : ге 

Еог Composite one the intercorrelations а 
presented in Table XIII. uted 

A multiple Correlation was then comp UE 
using the five objective measures of Spee 


š + та 
Tapping, the Deviation of Reaction Time in 
Positive 


multiple corre 
Shrinkage to , 69 (29). — 

The intercorrelations of the five a d 
measures for the twenty-six cases which E X 
Prise Composite two аге presented in pr ave 

Using the same type of procedure as ae a 
a multiple correlation was computed, we eto 
value of 66 апа ап expected shrinkag 
4596. 


т” 

The multiple Correlation coefficient for pe 
posite two wonlq ordinarily be expected to 057 
lower than the multiple correlation for iai а 
ite one since ще range in the criterion sco 057 
in the Second Composite is less than in lae v 
ite one, The Standard deviation for pem 
Опе 15.92, for composite two it is . 71. 15 jon 
be recalled that composite two is the Gre 
Score for those Subjects in their second po 
of teaching ang that nine subjects from the 0 


г the 
iginal test 8roup were по longer teaching in = 
second year, Six of these nine subjects И нев 
below the general mean of the criterion sco 
Accordingly, the 
were more homo; 
Criteria i 


Subjects of composite goi 
Seneous with respect to t s of 
ratings and the objective Hin 
: » іп general, were less discr 
Inatory for this more homogeneous group- 

Factor A of the Cattell 16 p. gr rn 
ated . 40 with the composite two criteria. ron 
factor was included in а multiple correlati 
with the five objective measures, It raise 


rel 
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TABLE XH 


OBJECTIVE MEASURES SIGNIFICANTLY CORRELATED 


WITH CRITERIA 


Composite 

Measure No. 1 

Speed Tapping .45% 
Deviation of Reaction Time in 

a Positive Direction „51* 

Fluency (Adjectives) . 41** 
„Ве в and Left Hand Coordination 57* 

49жж 


Maze Number 1 


N 


* Significant at 1% level 
**Significant at 5% level 


TABLE XIII 


INTERCORRELATIONS OF THE FIVE OBJ 
CORRELATED WITH CRITER 
(N = 35) 


Composite 


NEN Ecl 


T 


Correlation* 


2 


3 


ECTIVE MEASURES SIGNIFICANTLY 
IA (COMPOSITE ONE) 


4 


Measure 


Speed Tapping —-— 
n a Positi 


Deviation of Reaction Time i 

Direction .15 
Fluency (Adjectives) .19 
Right and Left Hand Coordination . 5 


Maze Number 1 


*Signs changed to indicate positive relationship 


:08 
„81 
.87 
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TABLE XIV 


TLY 
E MEASURES SIGNIFICAN 
CORRELATIONS OF THE FIVE ОВТЕСТІУ 
TOM CORRELATED WITH kc (COMPOSITE TWO) 

(N - 26 


Correlation 
Measure 


1 2 3 4 
Speed Tapping kas йз Т diis 


Deviation of Reaction Time in a Positive 


Direction ‚05 а 
Fluency (Adjectives) .12 .01 
Right and Left Hand Coordination 


.48 wal .20 
Maze Number 1 


297 „23 ‚28 17 


TABLE ху 


CORRELATION BETWEEN THE FIVE OBJECTIVE MEAS- 
URES OF TEMPERAMENT AND FACTOR A OF THE 
CATTELL 16 р, F. TEST 


_———___ 


Correlation* 
Objective Measures 


Factor A 
Speed Tapping 


. 04 
Deviation of Reaction Time ina Positive 

Direction . 04 
Fluency (Adjectives) +20 
Right and Left Hand Coordination . 48 
Maze Number 1 


. 07 
ЖАП signs Changed to indicate positive relationship 
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үе of the multiple correlation coefficient to 
е Although Factor A, when added to the objec- 
на теаѕигеѕ аѕ а predictive factor, does raise 

е multiple correlation such a gain is not made 
without losses. 


ca ны of Factor A is presented in 


Study of Individual Cases 


ау: Material for representative case studies was 
© ие in the data booklet* used at the Univer- 
Sity of Wisconsin each year to collect informa- 
don from students preparing for the teaching 
Profession, 
ta case studies were made, three ranked in 
5 ar quartile on the criteria scores (Subjects 
го 24) and the remaining three ranked in the 
h quartile (Subjects 4, 28, 35). 
tan, t was felt, from the data available, that the 
m Owing areas would be of importance: Sex, 
arital status, data on size of the family, the 
аа educational experiences, number and 
iue 5 of educational awards, the reasons for en- 
mm the teaching profession, any work ехрег- 
vase шше college, work experience during 
Boe periods, all extra-curricular and other 
p s participated in by subject, and the sub- 
qo а to the question of what he would 
X € had plenty of money. 
for Order to make the data more accessable 
will po Parison, the case history of each subject 
Pages, presented in graph form on the next few 
кн reviewing Ше case studies of those sub- 
oes ranked in the first and fourth quartile there 
Area not seem to be any clear-cut distinguishing 
that 8. It may be significant to note, however, 
tile general those ranked in the upper quar- 
ee to place teaching near the top intheir 
ould à when asked the question of what they 
ower 40 Ц money were по object; those in the 
botto Quartile tended to place teaching near the 
is fis of the list, or as in two cases used in 
h vestigation, eliminated it entirely. | 
dicate Н € does seem to be some evidence to in- 
Quarti hat those teachers ranked in the upper 
n ae list more extra-curricular activities 
S those in the lower quartile. 

id not the exception of the above areas there 
betwee appear to be any clear cut differences 
in the 1 Upper and lower quartile teach 

data available for the case studies. 


У 


ег5 


*Teag 
ada Personnel Research Committees 
on, Wisconsin, 
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SECTION IV 
SUMMARY AND CONCLUSIONS 
Statement of the Problem 


THE PURPOSE of this investigation is 
to study the relationship between certainaspects 
of temperament and teaching success. 


Design of the Stud 


The subjects of this investigation were thirty- 
five students who had graduated from the Uni- 
versity of Wisconsin and who had secured teach- 
ing positions in secondary Schools of Wisconsin 
in the fall of 1950. 

Aspects of temperament were measured by 
(a) the Thurstone Temperament Schedule, (b) 
the Cattell 16 Personality Factor Test, (c)a 
series of objective tests of tempo, fluency, 
speed, suggestibility, disposition rigidity, and 
dexterity—coordination. 

The criteria of teaching success was develop- 
ed from five ratings of each teacher: (a) the 
principal's acceptability, (b) the principal's M- 
Blank, (c) a rating given by one of a core group 
of graduate students trained in the visitation 
program and who visited the teacher inhis class- 
room, (d)a rating given by а staff member of 
the University of Wisconsin, and (e) а second 
M-Blank rating given by the principal in the sec- 
ond year of teaching. 

Using а composite score for the criteria, 
and the raw score from the measures of temp- 
erament, Pearson product-moment correlations 
were calculated to determine the relationship 
between the aspects of temperament and teacn- 


ing success. 


Summary of Findings 


No significant relationships were found be- 
tween the seven areas of temperament of the 
Thurstone Temperament Schedule and the cri- 


teria. 
In the Cattell 16 P. F. Test, only one factor, 


namely A, appeared significant. This was with 
composite two and was not consistent with cor- 
relation of composite one. When placed ina 
multiple correlation with measures found signif- 
icant in the objective tests it increased, how - 


pata Booklet; 


ever, the value of the multiple correlationfrom 
.66 to . 714. 


School of Education, University of Wisconsin, 


SUBJECT 5 


Reasons for Entering 
Teaching 


Marital Family Educational 
Sex Status Data Parents Education Awards 
Female Single Two older Father: completed None 
brothers the twelfth grade 


Mother: completed 
one year of college 
and is a graduate 


1. Advised by an- 
other person 
to teach 


2. Enjoys working 
with children 


Work Experience 
in College 
Library Assistant 


Student office help 
Estimates she earned 


2075 of living expenses 
while attending college 


nurse 


Work Experience 

during Vacation 

Girl Scout camp 
counselor 


Playground director 


Extra Curricular, 
Other Activities 
Field hockey 
Softball 
Games 
Tennis 
Radio play 
Drama Club play 
Junior class play 
Declamations 
Radio Workshop 
College play 
Band 
Glee Club 
Operetta 
Musica festivals 
Feature writer for 
class annual 
Camp counselor 
Pep club 
Girl Scouts 
G.A. A. 


3. Economic security 


Answer to Question: 

If you had plenty of money 

what would you wish to do? 
1. Theater 


2. Teaching 


06 


кошуопая 'IVLNSXINIHNdXS яо чумнаог 
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Five of the objective measures of tempera- 
ment were found to be significantly correlated 
with the criteria, namely, (a) Speed of Tapping, 
(b) Deviation of the Reaction Time in a Positive 
Direction from the Median, (c) Fluency (adjec- 
tives), (d) Right and Left Hand Coordination, 
and (e) Maze Number 1. These corre lations 
ranged from .39 to .57. 

А multiple correlation of . 734 was secured 
for composite one, and of . 66 for composite two 
When these five objective measures меге em- 
ployed ina regression equation. 


Conclusions 


In light of the results of this investigation it 
Seems reasonable to postulate that there may be 
certain temperamental patterns which will dis- 
tinguish between 5004 and poor teachersas meas- 
ured by ratings of principals and others trained 
to evaluate teacher effectiveness, 

It would seem from the data in this investi- 
gation that identification of these temperamental 
patterns can best be accomplished through the 
use of objective measures. The Thurstone 
Temperament Schedule and the Cattell 16 P.F. 
Test seemingly fail to identify aspects of temp- 
eramental behvior which аге related to success 
in teaching as measured in this investigation. 

It may be argued that the objective measures 
used in this investigation are restricted to теа5- 
uring only what they literally measure in the 
particular test Situation, that is, the Speed of 
Tapping Test measuring the speed of the subjects 
tapping in the particular situation in which the 
Sample of behavior was observed. It seems, 
however, that further and broader interpreta- 
tions might be inferred from these test situa- 
tions, 

If one makes these interpretations a “good” 
teacher may be described as follows: The “воо4” 


Ве termed “drive” or 
а. капу, the “good” 


the Psychomotor type. А1- 
be of temperamental 
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origin its temperamental correlates in obser- 
vable behavior are not clear. 
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TH 
of ibas ч EACHER influences, as а director 
Progress tours according to his abilities, pupil 
Сасћег5 кы. intelligent self-direction. Some 
and by thei hieve eminent success in their role 
accept цэнэ performance of duties while others 
subsequent е or even labor in vain with 
aS à result паша Success ог failure may come 
TS resident апу number of combinations of fac- 
nt in the social and physical environ- 


certain aspects о 
personal-group mo 
attention on се 


1. 


. Can definite ра 


{ social interaction and inter- 
des will necessarily focus 
rtain questions: 


current use of instruments such 
as sociometric techniques, audio-recording 
ratings. observation, personal adjustment in- 
ventories, and teacher ratings provide worth- 


while measures of teaching success? 

tterns of group social struc- 
tablished for the teacher and his 
d for the teacher and the partic- 


Does the con 
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cial competcnce as found in the modified so- 
ciogrims ? 

10. Is the variable of length of service in teach- 
ing a significant factor in the relationship 
between social acceptance and success in 
teaching? 


Terms Used in this Study 


Certain terms are defined below that will be 
used in the discussion of this investigation. Most 
all of these terms derive their meanings from 
the contexts of sociology, psychology, and edu- 
cation. Some of the words have been especially 
defined for the study. The definitions of terms 


as they will be construed in this investigation 
ire: 


1. Social competence is the human organism’s 
Cognition of ind adequacy with the mutual re- 


lations of mankind living in organized groups 
Or Society. This emphasizes the inter and 
intrahuman psychological function, and total 
Social environment. It includes all the social 
Sub-factors in the individual alone, or in his 
relationship to other human individuals, such 
as adjustment, acceptance, interaction, lead- 
ership, rejection, group dynamics, introver- 
Sion, status, etc. 

2. Success in teaching for this study means the 
degree of teacher achieved performance or 
endeavor in relation to accepted criteria. The 
terms teacher efficiency and teacher effec- 
tiveness will be used interchangeably and 
mean the same as teacher success. 

3. Social interaction is understood as the behay- 
ioral, intellectual and verbal processes of 
human individuals living life in groups, per- 
ceiving and cognitive of each other, and with 
а reciprocal set of relations to one another. 
These reciprocal relations are not necessar- 
ily equal in intensity. 

4, Group is defined and refers to two or more 
people who bear explicit psychological rela- 
tionship to one another. In this sense it does 
not merely mean classes of people such as 
teachers, farmers, or Democrats who are 
characterized only by some similar property. 
There may be sub-groups within groups. 

5. Dynamic is to be construed as ‘‘adjustive 
changes Occurring in group structure as a 
whole and as produced by changes in any part 

Е of Ше group. " (Krech and Crutchfield, 28) 

5 Study is defined as the 


manner of existence or 
form. 
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over-all picture of him in his professional and 
Social relationships. Тһе study will attempt s 
employ relatively new instruments and каш 
in the field of human relationships and socia ë 
competency which may be relevant to the т е 
tiveness of Ше teacher. This would assumes 
knowledge of how the teacher socially GERE. 
of himself and his role in the school as башат. 
to how colleagues, students ind others appr ais 
him in that social role is inexplicably interwo 
ven with teaching success. 

The панела тусше ИЙ 15 pe odis ea 
does not try to supplant teacher efficiency r ШҮ 
search up to Ше present time but rather 15 : ~ 
intended as a supplement to it. However, t (^ 
writer feels it necessary to raise a question в. 
light of completed work in the field to the n 
ent. The basic question at issue is just W pd 
constitutes an adequate measure of teacher € 2 
ficiency. The investigator wonders аа" 
teacher self-evaluations, student ratings, ма те 
ratings, and the relationships found и A 5 
are adequate measures of teaching ог wh e et 
these techniques used in conjunction with mo 
fied sociometric techniques, audio-recording |. 
ratings of classroom teaching and self-rate taken 
cial introversion and competency measures B 
Їгош a personality inventory might not yield 
better over-all view of the teacher. { 

The need for valid, reliable measures 0 aly 
teacher efficiency, so as to more effe ctiv ae 
train prospective teachers, improve the in-S 2 
vice training of teachers, and be more unbiaS иа 
in Ше promotion and dismissal of teachers; | а 
voiced by Boyce (14) as early аз 1915. “In 
absence of а valid and reliable criterion a rene 
teaching success, solutions for urgent pro: =й 
must be sought in the realm of expert оре 
one of Ше crucial problems in evaluation 0 atis" 
education of teachers is the discovery of à 5% 


d 


. P š š , as 
factory criterion of teaching success,” W 


stated in 1933 by С. L. Betts (10). Ina sumy 
mary of investigations by Barr (9), we are rte 
that among the results most frequently ер 
is Ше need for development of the criteria аё су 
which various measures of teaching еи 1) 
тау be validated. As late as 1952 Anders" а= 
states, “Іп general no adequate basis for ie i 
ation of teacher evaluations exists at prenhs to 
There is apparently no general agreemen ere; 
what is good teaching, and even if there W есе8” 
present day measures lack the reliability Эр = 
sary for valid criteria.’ On Ше basis o! Leah 
sibly adding other criteria for measuring e im^ 
er effectiveness, this study may have som 
portance. г- 
Should positive relationships between Уй cna 
ious measures employed in this study an that 
ing success be found, it might be implied асһег 
future consideration should be given by ue P 


пады ыз < : oe 18 
institutions, in-service training programs; 
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шы, and supervisors to Ше area of 50- 

еп to the av; E attention should be giv- 

ascertaining t able techniques in that area for 

Students pre he social status of teachers and 

accurate] eparing for teaching in order to more 
ately predict teaching success. 


SECTION II 
THE METHOD OF INVESTIGATION 


Т 
Ploying th IS A descriptive investigation, em- 
The hehe Ce method of study. 
eighteen x forty-one in-service teachers in 
8raduates 000518 senior high schools, аге 
‘ween the rom the University of Wisconsin be- 
instruct dene 1940-1952, inclusive. Nineteen 
teen teach various academic subjects andseven- 
in both ты. ы subject fields; five instruct 
rently (see етіс and special subjects concur- 
Cated in elis I. Allof the teachers arelo- 
area bound 0015 within a defined geographical 
fifty mile ed by a circle whose radius extends 
Th S from Madison, Wisconsin. 
САР 


The fi 
" l ісі 
tain rst visit to each school was made toob- 


pe lei 

Out t ми from the administration to carry 
Was А A letter of introduction 
Plained the | by the investigator which briefly ex- 
th 001 апа s cia project in the particular 
thi minist hich was personally addressed to 
te^ repr rative official in charge. Alongwith | 
мас to рсе samples of the testing ша” 

Sually th € used were also shown and explained. 
ап Superintendent or principal granted 
ад те аз a amodiately; sometimes it was 
Pr er the in result of action by the teaching St 

oject а, vestigator appeared and explained the 


ber at ° 
tion *SSio €achers’ meeting, and inone school 


Ч 
üt pics willingness to cooperate оп the 
tai А терен selected for the investiga" 
firs. d from un consent to cooperate was 027 
Я inte he forty-one persons during the 


ы. Th Tview, 
fide, да : 
sotti E Which were gathered were of à соп- 
it төсін апа Ure. Cooperation was ойегес 
ly bhe ain Бе aers with the understan 
Eve ке assi h. The schools have all ас 
Ч вась Ed an alphabetical symbol an 
керге = „нен by а number. . 
Stuq; `+ i ows Ше group us 
үү and the Subjects а in three other 
1 TES > Of School of Education graduates 
lversity of Wisconsin during the years 


for the years 1940-1952, between'the subjects 
studied and all of the graduating seniors from 
the University of Wisconsin with respect to their 
four year over-all grade point averages. It fur- 
ther shows the group studied and graduating sen- 
iors from the School of Education, year by year 
for the thirteen year period, ina comparison of 
their four year over-all grade point averages. 
The teachers studied in this investigation 
would appear to be representative of the рорша- 
tion of the School of Education seniors graduat- 
om the University of Wisconsin with re- 
spect to grade point average. In addition, allof 
the teachers in this investigation appear homo- 
geneous to the larger population composed of 
School of Education graduates in the following 
ways: (1) requirements for entrance to the Un- 
iversity and School of Education have been met 
by them, (2) their indoctrination and training ex- 
perience has been generally similar to that of 
other School of Education graduates, and (3) up- 
on graduation they have secured state high school 
positions. While the group may be heterogen- 
eous in many aspects, this also may be said of 


the parent population. 


ing іг 


The Instruments and Procedures Em loyed in 


Gathering the pata 


ring instru 


The measu ments employed in this 


study may be divided into two groups; those which 
ofessional teaching competence and 
sure social competence. The 
ts used to seek measures of teaching 


ctiveness wer 
Los м-ва ing, (2) qualified person's 
M-Blank rating, (8) teacher self-evaluationform, 
pil reaction to instruction blank, (5) confi- 
jal X-ratings of the teacher by an 0 utside 
persons’ ratings of aud- 


and (6) trained 

dings of teaching presentations. In as- 

g the social competence of the teacher, 
ta-gathering devices used were ав follows: 

fide r social distance scale, (2) 


teacher я 
(D) her -student social distance scale, (3) stud- 


tations. Individual explanation 
ll of the instruments used. 


is offered for а се 
г criteria are considered as а 


devices; 3 sone 
he reliability and validity of the 


criteria. Second, and also considered ава 
group, there follows 72 explanation of the instru- 
ments used to measure social factors, thepro- 
cedures employed in да а -ва пот ? пе and 
the validity and reliability of the instru- 


ments. 
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TABLE I 


E OF GRADUATION FROM THE 
IDENTIFICATION NUMBER OF EACH TEACHER, WITH DAT 
UNIVERSITY OF WISCONSIN, AND THE SCHOOL SUBJECTS TAUGHT 
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° 8 
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8 g| 2| 5 3 ° BIS (53 (3 8 |3 
= 5 a| j а 5 |. 15 12 Б |а a |g 
$5 | а! ВЕТ = 815 |а 15151512 s I a вк. 
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(27 1950 | z 
(49 1952 | à 
м (47 1952 х х | 
(5 1951 х 
(55 1943| x 
о (68 1950 х х х | 
(51 1950 | х 
1 ! : | 
Р (13 1950 х|х | х | 
Q (62 1949 | 
(53 1950 | Sh P 
(4 1951| x x 
R (34 1942 % х 
(36 1940 | х 
(40 1945 х | 
= 1 4 
otals 5 ај краја | +] 5 ЗОВЕ 112 15 15 |9 |1 |а | 2 | 1 
Grand Totals: 


-Saching Academic Subjects - 47 
Teaching Special Subjects = 22 
Note: Some teachers j 


ins д - - - 
teach more үш in both academic Subjects and in s 


number of teachers асаа Subject, Hence, the tota 


pecial subjects concurrently, or uim 
of subjects taught is greater than the to 
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TABLE III 


CH- 
А COMPARISON OF FOUR YEAR OVER-ALL GRADE POINT у vy 
ERS STUDIED IN THIS INVESTIGATION WITH EDUCATION SPMOR fred 
UNIVERSITY SENIORS FOR THE ACADEMIC SCHOOL YEARS 1 


Four Yr. Four Yr. 
Teachers Four Yr. No. of Over-All No. of. паша и 
Academic іп this Grade Pt. Educ. Grade Pt. University Grade Pt. 
Year Study Ave. Seniors Ave. Seniors Ave. 
1939-40 2 1.13 341 2.01 3142 1. E 
1940-41 0 "e 352 2.04 3882 1. ы 
1941-42 1 2.52 339 2.07 3568 1. 4 
1942-43 1 1.26 225 2.04 2766 1.9 
1943-44 0 NM 
1944-45 1 1.57 
1945-46 0 
1946-47 0 оле 298 1.74 5269 1.91 
1947-48 9 1.99 420 1.98 6221 1.90 
1948-49 1 1.79 969 2.01 8620 1.88 
1949-50 8 2.00 1181 2.02 9188 1.88 
1950-51 8 2.26 938 2. 02 6615 1.88 
1951-52 4 1. 64 761 2.05 5678 1.87 
Totals and 
Mean Aves. 41 1. 86 5824 1.99 55549 1.87 
Note: No records of grade point averages were kept by the University during the war 
years 1943-46. 


TABLE IV 


INTERCORRELATIONS OF TEACHING CRITERIA RATINGS 


Correlation 
Rating 1 2 3 
Composite of Supervisory 
E Уни 
Теаспег Self-Evaluation c зла LLL 
Pupil Reaction to Instruction +. 565 +. 262 |... 
Audio-Recording Ratings *.924 +, 11 +. 346 


(уо1. 23 


December, 1954) 


5 

Th Strum у 

да а uments Measuring Teaching Effective- 
S 


Administrator's М- Лалк Rating Scale: 


me d ige modified form of the W isconsin 
tigatór ion of the M-Blank was used by the inves~ 
mate the ын M-Blank requests the rater to esti- 
ореп-ера елсһег`5 strengths and weaknesses in 
"Genes г. categories and then rite them ша 
visitatio Evaluation" category. During the first 
he СОН to each school where one or more of 
ing School a selected for study taught, the rank- 
teacher ol official was requested to rate each 
intende on this form. In most cases, the super- 
à few nt or principal filled in the estimates; in 
и the assistant principal ог school su- 
gation $4 didit. The score used in this investi- 
Was cea the ‘General Evaluation” rating which 
as follo ed into categories опа five-point scale 
oe (1) outstanding, (2) above average; 
The ео 8 (4) below average, and (5) poor. 
timat er the point score the higher was the es- 
e of the teacher's over-all effectiveness. 


I ы 
nvestigator’s M- Blank Rating: 


түмен teacher in the study was rated by the 
ee during the time of visitation to the 
Was made classroom when the audio-recording 
е io ina one complete teaching presentation. 
9f the MR. form of the Wisconsin Adaptation 
Sàme сар lank was used for this purpose and the 
ЧаНод ategories, taken from the «General Eval- 
»” опа five-point scale were then utilized 


аз Sc 
Ores | wer l 
rating $. A low point score indicates 4 high 


each, 
ег Self-Evaluation Rating: 


Ev : 
М к forms were developed by Harold 
son of the University of wisconsin for 


Tru ЖАЗЫ peers and the teacher. The Teach- 
the ha Evaluation Form of this was placed in 
time of 


the ey of each teacher studied at the 
Was the interview. The score used in 
Sories наа evaluation (item 10). 
best he over-all evaluation were aS follows: 
(5) lowe, 2) second, (3) middle, (4) fourth, and 
St. A low score indicates a high rating: 


this study 
The саге“ 


Upil R 
action to Instruction: 


in the іп- 


Esti 
Vestion ates of each of the teachers 
tudents by 


хэв ü Әп Were secured from five 5 Я 

Slopeq Pupil Reaction to Instruction form de 

үеге зе by Harold М. Anderson. These students 

he Stu ected from each (еасћег 5 classes an 

а sealeq -$S returned their completed forms inc 

Sonne] Envelope furnished by the Teacher per 
Search Committee, directly to the 1n 
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vestigator. The teacher was requested to choose 
one student, the principal chose two students 
and the investigator chose two students at ran- 
dom to do the ratings. The sum of these five 
ratings on the last general category, with rat- 
ings, (1) best fifth, (2) second fifth, (3) middle 
fifth, (4) fourth fifth, and (5) poorest fifth, was 
the source for the pupil evaluation score used 
in this investigation. A low point score indi- 


cates а high rating. 
The Confidential X-Ratings: 


Little information, other than the method of 
scoring, can be given here about the X-ratings 
which were obtained from the Wisconsin 
State Department of Public Instruction of each 
teacher in the study becaus? of their confiden- 
tialnature. The highest possible score that 
could have been attiined was three. The lower 
the score the higher the rating. 

Professional Competence Ratings Based Upon 
Audio-Recordings of Teaching: 


Ап audio-recording Was made of a complete 
class teaching period of each person in the in- 
vestigation. During the initial interview a ге- 
quest wis made that three different classes and 
times which the teacher taught and was willing 
to have recorded be submitted to the investigat- 
or. Selection of the particulir class to be re- 
corded was then made by the investigator on ће 
basis of the following: (1) recordings were to 
be made of classes in the teacher's major field 
where it was felt he would do his strongest teach- 
ing, (2) recordings were made in the morning 
whenever possible 50 аз to insure freshness and 
alertness on the part of the teacher and students, 
and (3) availability of time was considered in 
recording dates 50 as to have participants re- 
laxed and ameniable to the task. 

Subsequent to the audio-recordings a rating 
scale was constructed. It was divided primar- 
ily into two sections; one section which was de- 
voted to items measuring professional teaching 
competence and the other composed of items 
measuring social competence. Two raters from 
the staff of the School of Education at the Univer- 
sity of wisconsin concurrently listened to each 
one of the recordings a minimum of one time 
and individually rated each teacher for teaching 
competence. The over-all score for each rat- 
ег'5 estimates wis obtained by summing the in- 
dividual items in their five-point scales and 
then dividing by the number of items. The two 
rater’s average mean scores of professional 
teaching competence were then combined and 
divided by two to obtain a Single score ranging 
between one and five. The lower the score the 
higher is the indicated rating. 
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Reliability and Validity of Teacher Efficiency 
Criteria 


The only reliability estimate obtained of the 
six teaching efficiency ratings used was made by 
ascertaining the reliability of ratings between the 
two persons who estimated the professional com- 
petence of teachers in this investigation from the 
audio-recordings. It was found that there exists 
a high coefficient of correlation (+. 95) between 
the over-all ratings of judges one and two on the 
professional teaching competence scores. This 
would appear to indicate that for both the items 
measuring teacher effectiveness in the rating 
scale and the estimates by the qualified persons, 
there existed a high degree of agreement. The 
intercorrelation of the composite score of the 
three supervisory ratings compared with the other 
three criterion scores can be seen in Table Iv. 

It can be observed that there is little correla- 
tion between the composite of supervisory ratings 
and the teacher's self-evaluation of his work. In 
all cases, the teacher’s self-evaluation shows 
little relationship with either the composite of 
ratings made by supervisors, pupil estimates of 
instruction, or ratings of audio-recordings (+. 079, 
+.262 and +. 171 respectively). The composite of 
Supervisory ratings does show a Significant rela- 
tionship (+. 565 and +. 524 respectively) with pupil 
reactions to instruction and audio-recording rat- 
ings. It is not known whether such discrepancies 
in outside raters is the result of different opin- 
ions expressed by the individuals making the es- 
timates, by changes in the teachers rated or by 
differences inherent in the measuring instruments. 
The correlation (+. 346) was found between pupil 
reaction to instruction and the audio-r e cording 
ratings, Possibly the students were in the posi- 
tion to rate their teachers on the basis of both 
seeing and hearing their teacher оуега much 


longer period of time, thus the discrepancy be- 
tween the two ratings. 


The instruments Measuring Social Factors 
Before 
tion of th 


г It is concerned with the actual psy- 
chological constit 


direction to the function of 
relationships rather than o 
office or station in life. Socio ives 

the interactive process, о dp DANH о 


(Vol. 23 


geography of society, the dynamic Без ме 
al structures which are Ше base for all а. 9 
phenomena....the structure in which the ny ~ 
аге imbedded and carried. It Шинийн At p n" 
study the latter apart from their locus is o 
The data-gathering devices employedto п E 
ure the social introversion, social ine aped 
social acceptance or distance, and social in Ss 
action (friendship choices) of the subjects ES 
lation to the school groups of which they Тіс 
a рагі are now considered individually. нае 
three ways in which data were gathered e aa 
ing social competence were, first, by AE еч 
ing the Minnesota Multiphasic реген, a 
ventory from which Social Introversion S ined; 
Social Competence (SC) scores were ob > дан 
second, through audio-recordings taken 0 ОМЫР 
of each teacher's classroom teaching d Де 
tion and from which ratings were obtaine 5 
oral factors of classroom social competen? fas 
and third, administering social distance t rat- 
to the teachers, staffs and students сэрсэн ар 
ings of social acceptance together with en Заг 
for friendship and social competence were rents 
cured. A critical discussion of the Teb Y il- 
used, the procedures employed and the ТУ. 
ity and validity of the tests is offered shor | 
However, before proceeding further it Шы іп 
well at this time to again emphasize cert stru“ 
terms and clarify the usage of one of the Bin 
ments so а5 to avoid possible confusion la ав 
In section one, Ше term social ue cnm 
is defined to mean the sum total of social : 
tors as they apply to this investigation. 4 
term is also used to identify certain data ~ 
ing from the administration of Ше Minn 
Multiphasic Personality Inventory, the Үй room 
social distance scales and ratings of Lo - 
audio-recordings. The original defi 
cial competence would include all other хэ ub- 
where usage of the same term applies to source 
parts of the study. Referraltothe pU о" 
will be made henceforth wherever the term 9 
cial competence appears in the investiga 


ви? 


Teacher-Teacher Social Distance Scale 


«jy for 

A social distance scale is used ргїтаг ic n 
the purpose of discovering the degree to o which 
individuals accept others in the group/S ссер! 
they belong, and how well the group/S °° per 
them. It provides opportunity for eani 3 
in a group to react to every other mem w be 
cluding reaction to himself regarding 10 pro^ 
thinks other members accept him. This wher? 
vides an extension to the usual sociogra m gro" 
only a limited number of choices of еше 
members сап be made by each individ 1088 

The instrument used to obtain socia n 
by colleagues of each teacher studied, 5 teach” 
to obtain his social rating of every othe 


December, 1954) 


ing s 
мэ. арыг was adapted and modified for 
Scale'orj н пош the Classroom Social Distance 
Struct à ja па Пу shown in the booklet, How to Con- 
Institute of Бороон by the Horace Mann-Lincoln 
Universit "t Experimentation, Columbia 
ent~Teaches 4). | The Teacher-Student and Stud- 
вегірей ew Social Distance Scales which are de- 
tions from ih WEES also adaptations and modifica- 
ег Social Di + same source. Тһе Teacher-Teach- 
9 obtain o v ance Scile was designed primarily 
teaching сад, social distance ratings from each 
had status варпе: Because the administration 
members шэн different from other staff 
id respons hich might have served to inhibit val- 
mietan it Was decided that the school ad- 
ticipate i n Should not have opportunity to рат“ 
Page n Such ratings. 
for use Ag of the instrument contains directions 
each Medeae Scale while page two includes, for 
1Уе catego 2 the staff members’ names and the 
ich ase s of social distance and acceptance 
Scores кы | аз а basis for obtaining acceptance 
One and fiy їп {һе investigation. Scores between 
leating th е were utilized with a low number іп- 
among era score. Page three contains, 
Te ав Shea two over-all requests which 
Wo 
of We s: please write down, on the basis 
activities. reasons (norms, environment, 
ed and еху “энийг ан and sentiment) list- 
ave айдал ained above, and any you may 
Pinion who the three teachers in your 
Saee оры lines teste ee these things. 
r place them in order of importance. 
1, 
——— 2. 8, — === 


and 
Are t 
L 
also си three colleagues you have listed 
est fri three teachers you consider your 
You 11 lends in school? If not, would 
St them in order. 


1, 


~ 2. ЕЕ 


е reg 
к t ses to the above two requests were 
she Қ река the modified sociograms of friend- 
own on Апа social competence which are 
tanc, t bx cre 112 through 121. 
їед с Scale Ше Теасһег-Теасһег 
Chi ien үн placed inthe hands 
Қаны 8 зоо member іп each of the € 
| Sether with a letter explainin 


ез, 
give Бабо 
Ven to р Along with these, an envelope Was 


Те 1 to th 
ас е te я езвей 
hag ee Рег achers which was adar e. they 


3 Son n 
Se е оры nel Research Comm?" 

Ale to р tion of returning the social distance, 
е Committee by mail or PY leaving 
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sealed with the central office staif of the school 
where it was picked up by the investigator. 
Table V gives data showing the possible num- 
ber (277) of responses which could have been 
received from each school and the actual num- 
ber (222) of responses obtained which was slight- 


ly over eighty percent of the total possible. 


TABLE V 


SHOWS THE POSSIBLE RESPONSES AND RE- 
SPONSES RECEIVED FROM EACH SCHOOL 
STAFF TO THE TEACHER-TEACHER 
SOCIAL DISTANCE SCALE 


Possible Responses 
School Responses Received 

A 8 4 
B 11 8 
с 9 8 
р 13 9 
Е 10 6 
Е 10 10 
С 26 21 
Н 13 12 
1 22 (59) 19 
1 18 16 
к 27 22 
L 11 9 
м 14 11 
N 23 17 
о 12 7 
Р 5 5 
Q 10 5 

45 (74) 33 


= 


р NENNEN LLL LL 


eptions to all of the teaching 
eceiving social distance Scales 
ing were inSchools I and В. It was de- 


i that, because of the large number of per- 
cided ing staffs (59 and 74 respec- 


tings should only be gathered from 
belonging to subject matter fields 
or departments in which the persons in the in- 
vestigation taught. Subsequently, twenty-two 
teachers in School 1 and forty-five teachers in 
gchool R were included in the ratings. A spec- 
s attached to the social distance 

ch of these schools explaining why 
d number of teachers was used. 
The reasons for this were: (1) that individual 
teachers in 50 large a teaching group may not 
have had opportunity to become acquainted well 
enough with other staff members to rate them, 
and (2) the largeness of the two groups did not 
make it seem feasible that individual members 


The only exc 
staff members T 


tively), rà 
the teachers 


scales in еа 
only a limite 
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would cooperate too willingly in rating so man; 
other pecple even if they knew them. 

The purpose in collecting the data was іс ob- 
tain, as has been stated eirlier, social distance 
ratings of te:chers studied and, in particular 
Schools, to ascertain the modified soc iometric 
modes of the teiching group. The ratings were 
kept strictly anonymous with exception of knowl- 
edge of the identity of responses by the persons 
in the investigition. In this Уу it was felt that 
the staffs’ г itings would be more valid and re- 
liable. 


Teacher -Student and Student- Teacher Social 
Distance Scales 


These two social dist ince scales were adapt- 
ed and modified for particular use from the 
Classroom Social Distance Sc ile mentioned earl- 
ier. The Teacher-Student ind Student-Teacher. 
Social Distance Scales are almost identical in 
form, with minor changes in directions and word- 
ing, to the Teacher-Teacher Social Dis tance 
Scale. Because of their Similarities, they are 
Considered together in this Section. 

During the first interview а copy of the Teach- 
er-Student Social Distance Scale was given to 
each of the forty-one teachers together with an 
envelope. Upon rating eacn one of the classes 
he tiught, among which was the particulir class 
of students selected for this aspect of Study and 
the audio-recording described earlier, theteach- 
er delivered the envelpe sealed into the hands of 
the investigator. From his rating, for the stud- 
ents in the class which was recorded, 4 score 
Was obtained which was used in the study. This 
Score ringed in number from one to five, with 
one indicating the higher score, 

The investigator idministered the Student- 
Teacher Social Distance Scale to the Students in 
the classes which had been selected for liter 
iudio-recordings, Students r ited all of the tea- 
chers they were being instructed by during the 


Second semester of the School year 1952-1953. 
The teachers who w 


ferent courses t uk 


(Vol. 23 


three of all the scales had questions whichasked 
for responses in the form of first, second ph 
third choices of friends and of persons who were 
1051 Sociilly competent. | . 
1 E ich of the mee = distance scales which have 
been described in detail avove was designed tü 
get the same basic kinds of information 00 о 
the teachers, one cliss of their students ап. i 
from colleagues. Thus various kinds of үне жеді 
distince scales hive the following beg eer лд 
so as to avoid confusion. Hereafter, the sc сэн 
аге reierred to аз S. D. S. and ire preceded Ч 
the words Телсһег-Телсһәг, Задов, 
or Student-Teacher. И Teacher-Teacher ыг > 
S. is used it means that it is a school st uff re 
sponse, Teacher-Student S.D.S. means it S 
the teacher's response for his students, an 
Student- Teacher S. D. S. contain responses о, 7 
students. Further, one instrument, the Teach 
er-Teacher S. D. S. was used to gather respon _ 
ses from both Ше teacher and the staff. There 
fore, in order to keep the teacher's aequ 
Separate from the staff responses, behind а 
designation of Teacher-Teacher S. D.S. is mt) 
enthetically either the word (Subject) or (St: 3» 
standing for teacher and staff responses resp 
tively. 


Р r 
The Minnesota Multiphasic Personality Inventory 


The Minnesot: Multiphisic Personality + 
ventory, hereafter referred to as Ше M. M. Цан 
was chosen as (һе personality measuring am 
ment from which certain measures of personn 
rated social adjustment could be abstracted a 
used in this study. The M. M. P.I. was ebo 
because of the following reasons: (1) 4 gu 
of the existing personality instruments lae а 
and experts' critical analyses, such as савол 
іп Buros (16), of them were read; the litera DG 
tended to reveal that the M. M. P. L. was as Р 
ог better than other such inventories ind we 
more valid and reliable, (2) the comp rative { 
ease and ficility with which administration orty- 
the instrument could be accomplished with 10 
one teachers in eighteen different logatio an 
the test lent itself to the combining ОЁ тоге s 
one of its scales into a composite termed 2585, 
cial competence, '' and (4) the M. M. P. L Да 
Among other trait Scores, a single quantitati 
score on an additional trait known as Social А 
troversion (SI) which was also used in this in 
vestigation. . іуе, 

The prevalent opinion is that the subject. 
Structured, paper and pencil personality pit 
tories are at best not to be relied upon to ja 
great extent. The M.M. P.I. however, is гес. 
ognized as being among the better available 
Struments. Ellis (21) states: 


Among the newer questionnaires the M. Na 
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Р.Д. à 5 

Phu Nae ota to be the most promising, 

iym aps because it gets away from the 

i ae pete which has hither- 
г almost synonymous wit г5оп- 

ality testing. цам m 


Rich 5 

of the она (37) corroborates this view іп one 

зеге recent reviews of the validation of 
ity inventories as follows: 


she anata Scale is in our opinion 

type sc 38 Ше ехпаизцуе questionnaire 

by the ша it is that most readily used 

it permit ient and most easily scored; 

answers de focus clinically on those 

he atypi at are of most interest, і. €., 
pical answers. 


Elli 
vali S (21) further reports that out of fifteen 


Valid 


Were negat 
tories compas Of four other personality inven- 
Inventory лун with the M. M. P.I. the nearest 
‘onal Data шнен it was the Woodworth Per- 
Ons out of e with only eleven positive valida- 
fourt wenty-nine, four being questionable 
Не NL negative. 
Ing scales ea I. gives scores on four validat- 
ш four inna, the nine basic personality scales. 
le scale Ва lating scales are a question scale, 
чде ог eed or (F) scale, and a test atti- 
Which scor Scale. The personality scales on 
Pochondri es can be calculated are those for Hy- 
Pathic De asis, Depression, Hysteria, Psycho- 
Sais, сан Г Masculinity-Femininity of Inter- 
chizophrenia’” Psychasthenia, Hypomania, and 
23 пе : 
ЗЩед мы are based upon clinical cases clas- 
Menclature ЛЕ to conventional psychiatric по- 
ig The А descriptions follow. 
tota”? еа Score (?): Тһе Guestion score 
Pus number o score consisting simply of the 
H *go T of items put in the “Саппо! Бау” 
Cores he size of this score affects other 


_ The Li 
чана пас Всоге (1): The Lie score is also а 
to sree to ге that affords а measure of the 
Б. falsi тъ ich the subject шау be attempting 
у Озе whig, 5согев by always choosing Ше ге- 
Eht, ich places him in the most acceptable 


is The уду 

em not Мес; Score (Е): The Validity score 

Se the ‘align у scale, but serves as à check 

fog ls nien Geen whole record. Ifthe Е 

от 3lid eitha? the other scales are likely to be 

Sog, ble to T because the subject was careless, 

ite; ene m comprehend the items, ОГ because 
p ~ extensive errors іп entering the 

Ч е record sheet. 

ally as соге (К): The К score is u$ 

Correction factor to sharpen 


ed еѕѕеп- 
the dis- 
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criminatory power 01 the clinical variables 
measured by the Inventory. As such, K acts 
as a suppressor variable. 

The Hypochrondriasis Scale (Нв): The Hs 
scale is а measure of amount of abnormal con- 
cern over bodily functions. 

The Depression Scale (0): The D scale 
measures the extent of the clinically recognized 
symptom complex, depression. 

The Hysteria Scale (Hy): The Hy scale meas- 
ures the degree to which the subject is like pa- 
tients who have developed conversion-type hys- 
teria symptoms. 

The Psychopathic Deviate Scale (Ра): The 
Pd scale measures the similarity of the subject 
to a group oí persons whose main difficulty lies 
in their absence of deep emotional response, 
their inability to profit from experience, and 
their disregard ior social mores. 

The Interest Scale (М1): This scale measures 
the tendency toward masculinity or femininity 
of interest pattern; a high score indicates an in- 
terest pattern corresponding to that о the op- 


posite sex. 


The Paranoia Scale (Ра): The Ра scale was 


derived by contrasting normal persons with a 
group of clinic patients who were characterized 
by suspiciousness, oversensitivity, and delus- 


ions of persecution. 
The Psychasthenia Scale (Pt): The Pt scale 
measures the similarity of the subject to psychi- 


atric patients who are troubled by phobias a nd 
compulsive behavior. 

The Schizophrenia Scale (8c): The Sc scale 
measures the similarity of the subject's respon- 
ses to those patients who are characterized by 
bizarre and unusual thoughts or behavior. 

The Hypomania Scale (ма): The Ma scale 
measures the personality factor characteristic 
of persons with marked overactivity in thought 
and action. 

The basic concept of the Inventory assumes 
that among the entire 550 items there are group- 
ings of items that can form additional scale s. 
The K-factor scale was developed in such a 
manner. An additional scale to those a bove, 
and one from which quantitative scores are used 
in this investigation, is the Social І.Е. Scale 
(Si) which aims to measure the tendency to with- 
draw from social contact with others. This 
scale is especially valuable for use with normals; 
under such heading the teachers in this study are 
assumed to belong. 

The М.М.Р.1. is copyrighted in an individual 
form and in a pencil and paper group form. De- 
cision was made to use the group form and, sub- 
sequently, each of the forty-one teachers re- 
ceived a copy of the test in group form together 
with an answer sheet designed for machine scor- 
ing. Since the Inventory is not timed, andsince 
the directions appear on the front cover of the 
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test booklet, no instructions were offered the 
subjects.' Test booklets and completed answer 
Sheets were collected during the next visitation. 
The responses were machine scored and individ- 
ual profiles made of each teacher by the Student 
Counseling Center at the University of Wiscon- 
Sin. The data and interpretations placedonthem 
are confidential so they do not directly appear in 
the investigation. M. M. P.I. profiles yield esti- 
mates directly in T-scores for the Social Intro- 
version (Si) scale which were used in the investi- 
gation. The lower the score the less there is 
tendency to social introversion or withdrawal 
from social contact with others. 

After consultation with two qualified clini- 
cians experienced in the use of the M. M. P. I. ав 
an instrument for personality diagnosis, it was 
mutually decided that another measure, which 
was termed ‘‘Social Competence, ’’ could be ob- 
tained from a composite interpretation of relat- 
ed traits as shown on the teachers’ profiles. 
“Social Competence"! here was considered to 
meanthe same s defined in Section I, page 100. 
The rank ordering of teachers, using the inter- 
prétations of the two qualified clinicians, for 
“social competence" was based on the following 
assumptions: (1) that the records belong to a 
so-called “погтша1” group of individuals, who at 
the time had no gross physical or mental illness, 
(2) that the more free the individual is from neu- 
rotic conflicts, the better adjusted he is, and 
therefore the more competent in his social en- 
vironmental interactions, and (3) that excessive 
“‘socializing’’ may be a function of anxiety, or 
in other words, an individual may ‘‘socialize’’ 
without being ‘competent, ? 

The records were first dichotomized, in the 
procedure for placing the teachers in rankorder, 
according to their deviations from the mean T- 
Score. Those who had scores of two or more 
Sigmas above or below the mean were placed in 
à lower group, on the basis of the statistics giv- 
en by one of the authors of the instrument that 
T-scores above Seventy occur in only one out of 
Seven records of normal people. 

The extent and nature of the deviating columns 
Consideration next. Due to the 
particular nature of the Mf and Pa columns, a 
great deal of caution Was used in their interpre- 
tation. Interpretations Were based on the con- 
figurations rather than Single elevations in any 
single column. According to statistics given by 
Meehletal in his “Pattern Analysis of the Minne- 

Personality Inventory", the 
most usual peaks in normal persons are on: 
(1) the Ma (Hypomania Scale) plus the Ра (Psycho- 
pathic Deviate Scale); (2) Ma (Hypomania Scale); 


(3) Hy (Hysteria Scale); and (4) Pt (Psychasthen- 
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consideration the extent of the individual peak 
and its relationship to the other relatively high 
and low points from the view of “зос1а1 compe- 
tence, ” | 

The records were judged finally for the ын 
(Social Introversion Scale) scores and the ВЕ. ы 
tent to which the ‘‘socialization, " as indicate 
by this column, would be successful and norm- 
ally gratifying to the subject and those around 
him, on the basis of the personality make-up 
obtained from the configurations in the afore- 
mentioned columns. Thus there was a good 
deal of re-shuffling after the initial gro eninge 
the final ranking is the result of a composite Sa 
all the named factors which could indicate sue 7 
cial competence. " Тһе rank order of the for a 
one teachers was converted to individual Tegore 
which were used in the investigation. The high 
er the T-score the more socially competent the 
individual is. 


Audio-Recorded Teaching Presentation Social 
Ratings 


Earlier in the investigation it was state 3 
that an audio-recording was taken of a selecte 
teaching presentation, It has also been рок 
iously explained that Subsequent to the record 
ing, a rating scale was constructed which was 
divided into two different sections. One section 
was comprised of items purporting to measure 
professional teaching competence while the othe 
Section was composed of items measuring S07 
cial competence. The same recordings of се ИЙ 
ching presentations which were rated for mel 
ing competence by the two trained persons We EN 
also simultaneously rated for social competen 
The method of attaining the single score fore 
teacher was the same as stated in the section 1 
devoted to Audio-Recorded Teaching Presenta 
Поп Professional Ratings, page 105. The low 
Score indicates ihe high r ating. 


Reliability and Validity of Social Competence 
Criteria 


A reliability estimate was obtained betwee 
the two raters who estimated the social coni 
tence of the forty-one subjects from the аш 
recordings. Тһе data reveals thatthere exis us” 
a high relationship (+. 99) between the yep а 
ing the same instrument to measure the за 
recordings. No other reliability estimates ing 
were made of the other instruments measur? 
Social competence and interaction. Table stru- 
contains the intercorrelations of the five іп 
ments used to measure social factors. ich 

The relationships shown in Table VI whi 5 
exist between measures of social factors pa 
not too high but it would seem reasonable c re 
assume that the opinions of the raters Wer 
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liable a i А 
instruments used. the time of rating and for the 
о i ; 
s а кеш usus briefly, the discussion in this 
design шээг ееп devoted to a description of the 
the уа ыы how the selection of 
ia of teachi eachers was made, the six criter- 
social Demi Success and seven measures of 
Were жеттен: and the method by which Ше data 
to show лэ е ү: Attempt is made where possible 
mente ата dem idity and reliability of the instru- 
Population. representativeness of the selected 


SECTION III 
ANALYSIS OF THE DATA 


TH 
da "on LATION and analysis of these 
Set forth in рени according to procedures 
the raw sco e materials to follow. After all of 
Ing винове аш for Ше various criteria for teach- 
Sembled а fs social competence had been а5- 
decided that th laced in an over-all table, it was 
Ministrator the State Department X-Ratings, Ad- 
Or's ГЭЭХ NE Ratings, and the investigat- 
Single com Rating would be combined into à 
for ын Score. This was accomplish- 
апа then д еасһег іп the study by first totaling 
resultant pa the two M-Blank scores. The 
and avera уегаве M-Blank score was then totaled 
Core, х with the State Department X-Rating 
Intercorrels composite score was derived. 
®fficients ee were then calculated and со- 
efficien tained between each of the four teach- 
Deteney m Cy measures and the seven socialcom- 
atio mo or for a total of fifty-five согге1- 
above we анал! relationships of +. 300 ог 
Correlation found in twenty-five of the fifty-five 
was ree Tice twelve were +.500 or higher. 
ed байсаан таша if mean differences 
east succ n the most successful teachers 
te, cided th essful teachers. It was arbitrar- 
еп person. at approximately one-third, ог four- 
te. Ourteen | would comprise an upper gr o up 
se hi etfi people a lower group. The four 
hieutively t ciency criteria were employed con” 
igh о select a different group each of 14 


an 
d 14 low teachers. 
of 
ful 


Ompar; 
mathe ges were made between pairs 
tis least s omparing the first most success 
fel. Mites teacher followed by the ne 
We tea er Sful teacher and next least success- 
time, higher etc. The most successful teachers 
севе апа 1 а total of 227 times, even fifty-five 
Sful tea ower 110 times than the least SUC" 
the ; ven x IN in paired mean difference? on 
th teache easures of social competence. Where 
the fourte г self-evaluation was used to S° lect 
8 fo €n upper and fourteen lower teachers, 
een least successful teachers here рго- 


exist 
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vide the only excepti ievi i i 
А ee of achieving higher paired 
Modified sociograms of friendship and social 
competence choices were tabulated from answers 
to the last two questions of page 3 of the social 
distance scales. After all of the first, second 
and third choices were totaled for both social 
competence and friendship, it was decided that 
modified sociograms would be drawn for illustra- 
tion purposes only of the three most successful 
teachers and the three least successful teachers 
with their respective school staffs. Identifica- 
tion of the three most and three least successful 
teachers was made from the four tables of mean 
differences. The chosen teachers were those 
who appeared most consistently, without rever- 
sal to the opposite group, in their respective 
high or low groups. Once selected, sociograms 
were drawn of these teachers in relation to their 
respective school staffs and are shown on the 
next several pages with accompanying explana- 


tions. 

The modifie 
11, 14 and 20 rec 
second and third c 
from their students out о 
responses whereas teachers 2, 45 and 47 re- 
ceived a total of ten choices out of à possible 11, 
The most successful teachers, 11, 14, and 20 
received twelve first, second and third choices 
in social competence out of a possible total of 
138 school staff responses. The three least suc- 
cessful teachers, 2, 45 and 47 were chosen two 
times by their school staffs whose first, second 
and third choices in social competence totaled 


117. 

The three most successful teachers received 
totals of seventeen school staff and fifty-four 
student friendship choices out of 138 and 354 (0- 
tal possible responses respectively. Three 
school staff and ten student friendship choices 
were received by the three least successful tea- 
chers from possible total responses of 117 and 
171 respectively. 

When compared with individual members of 
their respective teaching staffs in social compe- 
tence and friendship choices, the three most 
successful teachers appear to be among the :ead- 
ers or at least have sub-leader status. The three 
uccessful teachers, on the other handare 


d sociograms show that teachers 
eived a total of sixty-six first, 
hoices in social competence 

{ a possible total of 354 


least 5 
relative fringers and isolates. 
Tables УП, УШ, ЇХ and X present analyses 


of the number of friendship and 50- 
cial competence responses each of the six teach- 
ers received and a percentage comparison show- 
ing differences between the three most and three 
least successfulteachers. The three most suc- 
cessful teachers, 11, 14 and 20, received 10.4% 
and 12.9% whereas the three least successful 
teachers, 2, 45 and 47 obtained . 98% and 7. 4% 
of the total staff and student social competence 


in percentage 


JOURNAL ОР EXPERIMENTAL EDUCATION (Vol. 23 


112 


“SUASWAW 41716 JO S3DIOHD 
INSGOALS IN3S3Ud38 SAIS LSY JHL TUHA заллав 
ЛАЗНЕ ЗОЗ SASNOdSAY А4У15 JO G3SOdINOD ану 
SINVESOIDOS ЗАП 15н14 
чо GQNODAS 1584 з1уса 


19 S3DIOHO анїн1 
1 МОУ НЭУЗ ЭМ! 


HL 31VOIQNI зомазааиоо 
‘MID алун ноти JHL NO SAONUV JHL ‘запозо 
INSGÜLS NO 44У15 JHL AO SHSGINSIN ЯЯНЫ О мона 
NOSt3d ноуя АЯ азлтяоан SADIOHD SDNALAdINOD 
ЛУІ205 1ма<$янаян 310NIO HOVE чо зоманзайпо 
ЭНЭ ЯЛУН 1481 зна 40 3915110 ян1 NO млуна 
$/МОЗЧУ 'SHATVH OLNI 5910410 JHL 3GIAIG S3NIT 
аз110а "VOLLUSA ATIHALLO3dS3N 114155322016 
ASVAT 33HH. ANV LSOW зачнт зна ASLLNSOI 
(UVANAOG чо аяулап ONILNIOd SMOUNV JHL 
JUHA SUSHOVS. 1045580005 ISV31 аму 1507 
XIS зна. пломаа SNSINSISV JHL 'S31ONIO НЯОМУЛ 
HHL NI YIWAN V АЯ GSIJLLNSCI ану а31а01$ 
SUSHOVAL ана “авиаг! 44У15 V зрмазачазч 
TIOSWAS YALLET аззолома му ната ато HƏVA 


SWVUSOIDOS TIV ноз амяоят 


| ! 
1 1 
< (x О: г 
| ! 
! ! 


1 ! 1 І І ! 
bh аму ‘62 ‘bI TI SHHHOVR.L МОЈ SHOIOHO «ІН5бАМЧІЯЯ аму FON 


! 
І 


ге 


“4172 


- “о 
там 


l 
! ! 


ALATWOO 


TVIOOS 44У16 TVILYVd окпощяа I TOOHOS NI 44У16 AHL 40 МУМООГОО5 G3HIGONWN 


December, 1954) 


113 


БІМСЕН 


MODIFIED SOCIOGRAM OF THE STAFF IN 

SCHOOL M DEPICTING PARTIAL STAFF 

SOCIAL COMPETENCE AND FRIENDSHIP 
CHOICES FOR TEACHERS 20 AND 27. 
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MODIFIED SOCIOGRAM OF THE STAFF IN 

SCHOOL Е DEPICTING PARTIAL STAFF 

SOCIAL COMPETENCE AND FRIENDSHIP 
Mai эш FOR ас SERS 2 "e 60. 
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MODIFIED SOCIOGRAM OF THE STAFF IN 
SCHOOL Н DEPICTING PARTIAL STAFF 
SOCIAL COMPETENCE AND FRIENDSHIP 
CHOICES FOR TEACHER 45. 
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STAFF IN SCHOOL M DEPICTING STUDENT 
SOCIAL COMPETENCE AND FRIENDSHIP 
CHOICES FOR TEACHERS 2 AND 60 
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TABLE VI 


INTERCORRELATIONS OF SOCIAL CRITERIA RATINGS 


Correlation 
Rating 1 2 3 4 5 

Teacher-Teacher Social 

Distances Seale аны аға зөн | шшш һәлә 
Teacher-Student Social 

Distance Scale ШЕНЕ | | weese awaa |) рг |) son š 
Student-Teacher Social 

Distance Scale 4.591 4.199 — oves өз." 
Recording Ratings of 

Social Competence +.278 +.315 45954 ца вене 
М.М. Р.І. (Social 

Competence Scale) -.385 -2282 -. 477 =. 503 ее. 
М.М.Р.1. (Social Intro- 

version Scale) -.186 -. 077 -. 104 -. 007 -. 093 


Note: The coefficients for the M. M. P. I. (Social Competence Scale) with minus signs 


аге actually positive correlations. 


TABLE VII 


SFUL 
DEPICTING DATA WHICH SHOWS THREE MOST SUCCESSFUL AND THREE LEAST SUCCES | 


TEACHERS AND STAFF SOCIAL COMPETENCE CHOICES RECEIVED BY THEM 


Social Competence Social Competence 


Social Competence 


1st Choices 2nd Choices 3rd Choices 
Teacher No. Possible No. No. Possible | Мо. No. Possible 
School No. Rec'd No. in % Rec’d No. in% Вес Мо. 
Three Most Successful Teachers 
I 11 1 19 5% 9 
б 1 19 5% 0 1 
r N 2 19 10% 0 19 0% 2 19 
0 3 11 27% 2 11 18% 1 11 
Average Total 14% 9. 3% 
” Three Least Successful Teachers 
5 P4 0 10 0% 0 10 0% 1 10 
" 47 5 12 с 1 12 8% 0 12 
17 0, 0 17 0% 0 17 
Average Total 0% 2.6% 
«070 
Average Grand Tota] ог Staff Soci 
Social Compet i i 
the Three Most БСО. Зэвсэгт” Choices received by 


Average Grand Total o 


the Three Least Successful Teachers 


1 Competence Choices Received by 


No. ў 
in% | 


0% 
10% 
9% 


76. 30b 


1% 
0% 
0% 
E 


10.4% 
980 
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TABLE VIII 


CESSFUL AND THREE LEAST SUCCESSFUL 


, БЕРІ 
! CTING DATA WHICH SHOWS THREE MOST SUC 
ICES RECEIVED BY THEM 


TEACHERS AND STUDENT SOCIAL COMPETENCE CHO 


š Social Competence Social Competence Social Competence 
181 Choices 2nd Choices 3rd Choices 
Teac Б 
School CR No. Possible №. No. Possible Мо. No. Possible Мо 
. Recd ко 1896 Rec'd No. in% Recd Ко in% 
š Three Most Successful Teachers 
I 12 43 28% з 4 To 3 43 "% 
м 20 8 43 18% 6 43 14% 8 43 18% 
10 32 3% 10 32 3% 6 32 19% 
Average Total 16% 8% 14. 6% 
-970 
F Three Least Successful Teachers 
H É 0 10 0% 1 10 10% 2 10 20% 
N 47 0 19 0% 3 19 16% 4 19 21% 
0 28 0% 0 28 0% 28 % 
А 
verage Total 0% 8. 6% 13. 6% 
Aver 
age M Total of Student Social Competence Choices Received by 
Average G e Three Most Successful Teachers | 12.9% 
rand Total of Student Social Competence Choices Received by 
7. 4% 


the Three Least Successful Teachers 


TABLE IX 


SUCCESSFUL АМ 
HOICES ВЕСЕ 


р ТНВЕЕ LEAST SUCCESSFUL 


ТЕРІС 
т 
ING DATA WHICH SHOWS THREE MOST ЕЕ Ey THEM 


TEACHERS AND SCHOOL STAFF FRIENDSHIP C 


iendshi iendshi Friendship 
Friendsh Friendship 
Ist Choices 2nd Choices 3rd Choices 
“їнэ ЊЕ 1 ible №. No. Possible Мо. 
l No. Possib о. No. Possi 1 | 
№. Неса "No. ш Да Веста No. in% Rec'd No. in% 
I Three Most Successful Teachers 
I 11 4 а; 2 19 10% 1 19 5% 
м 14 3 5 16 1 19 5% 2 19 1 oj 
ин 2 11 18% 1 11 9% 1 11 % 
А 
Verage Tota] T^ "4 = 
t Three Least Successful Teachers 
N Я 0 10 0% 10 10% 1 10 10% 
ü ed 0 12 0% 1 12 8% Е 12 я 
ш 0 11 0% 0 ЇГ 0% 17 07 
А 
Уегаре То{а1 m 6% ^ 
Ave - 
lios энээ Total of Staff Friendship Choices Received by Three ща 
А ost - 
iis Saee ee Prien ship Choices Received by Three 
3. 1% 


Grand Total of Staff Friend 
Least Successful Teachers 
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e respectively. For iriendship responses 
teache E Staffs and students, the upper three 
while сы received totals of 11.3% and 14. 7% 

е lower teachers obtained totals of 3.1% 


and 7, 00; respectively. 


SECTION IV 
SUMM 
ARY OF FINDINGS AND CONCLUSIONS 


T 
tion st B RSONS studied in this investiga- 
een и in-service teachers in eight- 
Graduates fees Senior High Schools, and were 
Riversity wom, the School of Education of the 
1952 De d Wisconsin between the years 1940- 
In public ғ. АП of the teachers were located 
educational institutions within a defined 
area bounded by a circle whose rad- 


пеовгарнсац 
xt Š 
ended fifty miles from Madison, Wiscon- 


e 
Sin. 

Th | 
%аз foi er mative-survey method of investigation 
Ployeg ee. in this study. The instruments ет” 
Categories, а data which fell into two major 
MU Cess ing data that were relative to teaching 
Petenc data that were relative to 500141 com^ 
i За 200181 interaction and group structure. 
ing an opa In teaching was identified by obtain- 
(Sing the “сын judgment for each individual by 
(1) teache 9llowing composite teaching criteria: 
ratings y lend ratings, (2) adapted M-blank 
cient 5-4 Ocal adn:inistration, (3) state depart" 

* teac cre AN X-ratings, (4) student's ratings 
(0) гай (5) opinion of a trained observer. 
in ling t я by qualified persons of classroom 
me, Ula Pugh audio-recordings. Data regard- 
үзігі ne were identified by: (1) 500107 
Big ss modified for use in classrooms 
al соп, and students, (2) opinions of judges 
Self аси y 45 heard in audio-record- 

“Tated зо ПЕ presentations, and (3) teacher 
Уагі ен adjustment апа competency t 
fo, bles elations were obtained for аПо ће 


Of ga 


ou S meas 

За? то ен, Mean differences of the 
mos each Successful and fourteen least suc 
ide : €rs were calculated. The three 


rela- 


t 5 modified sociograms show 
lon to üt апа ciogr 
con- 


Str eir «octal competence status in 
Ча" l'éSpective teaching staffs were 


in; tl 
Initia Purpose 


the г State of the present investigation as 
Cent lation rd in section one was to determin? 
Зоог! factor? between success in teaching ап 
моде Comp, TS of social interaction, individua 
Bro >: (елсе апа inter-personal-grouP 
"eaedem, Ttain questions seemed related to the 
heq eso together with the conclusions 


аге 


L. as follows: 


Oe. 
5 th 
e " 5 
Concurrent use of instruments such 
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as sociometric techniques, audio-recording 
ratings, observation, personal adjustment 
inventories, and teacher ratings provide 
worthwhile measures of teaching success? 


Summary 


Coefficients of correlation were obtained 
for all of the various instruments used in 
this study. Twenty-five of the fifty-five cor- 
relations show significant relationships (+.300 
or above) between each other and twelve co- 
efficients are +. 500 or more. Social dis- 
tance scores have been ascertained for each 
teacher and for each teaching staff to which 
he belongs. Twenty-nine of the forty-one 
teachers in the investigation have indicated 
by their social distance scores, which are 
lower than the teaching staffs’ scores of them, 
that they accept their colleagues more than 
they ure themselves accepted by the groups, 
Equal or mutual acceptance by both the staff 
and the teacher is found in two cases, teach- 
ers 48 and 53. The other ten teachers ас- 
cept their colleagues less than the staffs ac- 
cept them. Modified sociograms of the teach- 
ing staffs and one cliss each of the three 
most successful and three least successful 
teachers are to be foundon pages 112 through 
121. Patterns of group structure were found, 
and individual group leaders, fringers, and 
isolates were identified. The summary un- 
der question 2 which follows gives a more 


thorough explanation. 


Conclusion | | 
Тһе сопсиггепї изе of sociometric tech- 


niques. audio-recording ratings, оозегуа- 
tional ind administrative evaluitions, and per- 
sonal adjustment self-ratings would appear 

to provide partial measures of teaching suc- 
cess. Some of the coefficients of correlation 
obtained in this study in the area of s оста! 
competence were such as to merit further 
study. The modified sociograms and social 
distance scores appear to provide definite in- 
sights into why the individual person may 
succeed or failas a teacher. The three most 
successful teachers in this investigation are 
all. for example. in positions of comparative 
leadership 18 shown in the modified socio- 
orams and аге greatly accepted 15 members 
of the teaching group to which they belong. 
The three least successful teachers in the 
study as depicted in the sociograms are fring- 
ers or relative isolates in their respective 
teaching staffs ind are not too well accepted 


socially. 


Can definite patterns of group social struc- 


tures be estaolished for the teacuer and his 
classes, and for the teacher and the partic- 
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Шаг school staff to which he belongs? 


Summary 

Examples of such group social structure 
patterns are shown in the modified socio- 
grams in section III. The sociograms were 
Specifically drawn to show the three most suc- 
cessful teachers (11, 14 and 20 in schools I 
and M), and the three least successful teach- 
ers (2, 45, and 47 in schools F, H and N), in 
relation to the particular class studied and 
staff group structures of which they were 
part. Teachers 29, 44, 27, 5, 55, 49, and 
60 are also included in the modified socio- 
grams because they were members of the 
above school staffs. Teachers 11, 14 and 20, 
the three most successful, received social 
competence choices from their students total- 
ing sixty-six and from their teaching staffs 
totaling twelve out of 354 and 138 possible 
choices, respectively. The three most suc- 
cessful teachers received friendship choices 
from staffs and students totaling seventeen 
and fifty-four, whereas the three least suc- 
cessful teachers received three and ten total 
friendship choices, respectively. 

The three most successful teachers appear 
to be teaching staff group leaders or have at 
least sub-group leader status, while the three 


least successful teachers are found to be iso- 
lates and fringers, 


Conclusion 


It would appear that definite patterns of 
group social structures can be established 
for the teacher and his classes as well as for 


the teacher and the particular teaching staff 
of which he is a part. 


. Is there a relationshi 


| p between these group 
Social structures an 


d success in teaching? 


Summary 


S received by thethree most 
ers is 14. 7% ang that for the 
essful teachers is %. 


Successful teach 
three least зисс 


Conclusion 
One 'usion 
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e 
are the least successful teachers. 2 иа 
effective teachers occupy positions of lea ын 
ship and higher status whereas the poo eod 
teachers are isolates or have only one m 
friend on the staff. 


US 
. Is there a relationship between the teacher 


i i is 
self-concept of social adjustment and h 
teaching success? 


A. The Teacher-Teacher Social Distance 
Scale (Self-Rating) 


Summary yeen 
Little or no relationship was found bety 


the teacher's self-concept or social a 
ment and teaching success with one sey ee 
A low but significant correlation (+. 5 icm: 
ists between the teacher's self-evalua pee ре- 
his teaching and his self-rating of how 


negative relationship (-. 045) is ширэн 
Ше composite score of Supervisory 
and the Teacher-Teacher Social 015 pown 
Scale while a correlation of +. 133 15 ой re" 
between the Pupil Reaction to cis cA 
sponses and the self-rated Теасһег- 
Social Distance Scale. Almost no re profes 
ship (+. 032) is indicated between the л 
Sional Recording ratings and the Ter rod 1 
Teacher Social Distance Scale (self-r? 
Conclusion пс1897 
From Ше data, presented it can be" he 
ed that the teacher's concept of how в pears _ 
feels he is accepted by his colleague, of suc 
little or no resemblance to the deg” t tha 
cess he attains in teaching. Тһе neil be^ 
there is а low but significant relation? oach” 


à his tez” 
tween the teacher's own ratings of investi 


ing and social acceptance leads Ше ES are 
gator to wonder to what extent in i БЭР 
Subjectively biased in all phases = critic? 
ing and whether self-evaluations аге ciné 
enough to be considered де 
for measuring efficiency in teac 
4 š tance 

B. The Teacher-Student Social Dis 

Scale (Teacher Self-Rating) 
Summary 66) 


M a 
Correlations (+. 150, -. 068, ын е istan 
between Ше Teacher-Student 50018. - cce 
Scale and the composite po nl case Ба 
in teaching are insignificant in аі с п 
cept for the Professional Recording 
(+. 441). 


Conclusion 


t 
1g #5 
It is concluded that the teacher 


~ 
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3 Аге th 


tion of how well he is accepted by his students 
has little to do with how well he is teaching. 
Itis possible that in rating himself for accept- 
ability by students he places greater weight 
on the oral factor and abstract factors in tea- 
Ching to the exclusion of other prime requi- 
Sites. This could account for the significant 
relationship found between the teacher's self- 
i дано of acceptability by students and 
pied аш Recording ratings which were 
ањ entirely on oral and classroom sounds 
m audio-recordings. 


C. The Minnesota Multiphasic Personality 
Inventory 


Summary 
md ыык. scores from each teacher 
indis 5 tained from this inventory; one score 
cial а: = the amount of tendency toward 50- 
хи cea and the other toward social 
Ше епсу. Тһе higher the score іп the 
Жага т не the more the teacher tends to- 
fer 22 esired social tendencies; in the lat- 
tions ae reverse is true. Thus correla- 
теа о negative signs constitute positive 
with s nships where comparisons are made 
оста! competency. 
(Е, бта 1 high coefficients of correlation 
imet 55, -.464, and -5.19) were found 
and the st all cases between Social Competency 
cess не measures of teaching suc- 
pared ж.н Introversion scores when com- 
-.471 the teacher efficiency criteria were 
› *.776, -.031, and -. 048. 


Conclusion 


a oe introversion, as part of the M. M. 

3, 411) to appear to be moderately significant 
ас теи the amount of success a teacher 
Self may į In other words, the teacher him- 
and сап. ден he is socially introverted 

y others ill be judged adequate as a teacher 
13 that the One particular point worth noting 
Socially ie teacher who judges himself most 
to be Шы асы seems to believe himself 

Sàcher 5 etter teacher (+. 776 between the 

Ше анны and SI score). 
аа composite of many social factors 
зар in the M. M. P.I. аге combined in- 

e „оста! Competence score there seems 
UM internal consistency. A moderate 
een ыг relationship appears to exist be- 

8 lug Der success and how well the teach- 
Judge he is socially competent. 


mea 
to t 


deg. 


er 


° teachi t group's 

со ing staff and student group 5 

ity сері of Ше teacher's social acceptabil- 
elated to efficiency in teaching? 


А. 
Teacher-Teacher Social Distance Scale 
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(Staff Rating) , 


Summary 
Moderately high relationships (+. 431, 


4.581 and +. 352) were found to exist between 
the staff's rating of the individual teacher 
for social acceptability and measures of 
teaching success except with the teacher’s 
personal estimate (-. 088) of his own teach- 


ing. 


Conclusion 
The degree to which a teaching staff ina 


school socially accepts each one of its indi- 
vidual members has a definite relationship 
to the performance of each person on the 
staff. Inasmuch as there is slight negative 
relationship between the teacher's rating of 
his own teaching and the staff’s social accept- 
ance of him, it is concluded that the individ- 
ual teacher and the teaching staff do not con- 
sider the same aspects, especially in area 
of social acceptance, to be of equal value in 
attaining success in teaching. 


B. Student-Teacher Social Distance Sca le 
(Student Rating) 


Summary 


Significant coefficients of correlation 
(+.702, +. 750, and +. 369) were found to ех- 
ist, in all but one case (+. 069, Teacher Self- 
Evaluation and S-TSDS), between the Student- 
Teacher Social Distance Scale ratings a nd 
teaching success measures. 


Conclusion 
The degree to which the students in the 
teacher's classes accept him socially is to 
a considerable extent related to his effective- 
ness as a teacher. It is further evident that 
the teacher, in appraising his own profes- 
sional acts, does not include social accept- 
ance by his students as one of the requisites 
to teaching success, or else the instruments 
used are not refined enough to measure 
the relationship as it exists. 


‚ If there exists a high or low degree of social 


acceptability by the group/s for the individual 
teacher, does there also exist a high or low 
degree of personally judged social adjustment 
and success in teaching? 


Summary 

A coefficient of correlation of -. 255 (pos- 
itive relationship) was obtained between the 
self-rated teaching evaluation and self-rated 
social competency while а +. 321 relationshi 
was found existing between the self-rated š 
teaching evaluation and the subject's self- 
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o. Do there e 


rating on Ше Social Distance Scale. Coeffic- 
12068 of correlation of +. 039 and -. 050 were 
obtained between the particular class and 
staff ratings of the teacher on the Social Dis- 
tance Scale and his s-lf-evaluation of teach- 
ing. 


Conclusion А 
С The degree to which а teicher is success- 
ful in his veroal coni.nunication ina cla 55- | 
room apparently his definite bearing on his 
effectiveness as a teicher. The social com- 
petencies of oral interaction such as eliciting 
willing responses from students by construc- 
tive and encour ging comments; the degres 
to which cooperation is offered in class plan- 
ning, activities, evaluation, and total learning 
process; the ability to take a joke and joining 
in with the class ina good laugh; being self- 
Controlled in the midst of conflicting demands 
and never sounding angry, ote, ‚ are pertin- 
ent to the success of th: teacher, 
The relatively low relationship (+.171) ex- 
isting between the Teacher Self-Evaluation 
Rating Scale and the R.cording Ratings (So- | 
cial Competence) apparently points out that 
either the teacher does not consider, or does 
not have the Opportunity to consider because | 
of limitations of instruments, oral socialcom- | 
petency as important to teacher efficiency as 
the other teaching criteria appear to possess, 


xist mean differences between the 
most successful teachers and the least suc- 
cessful te ichers, as evaluited by the virious 
Criteria of teaching Success, in the measures 
of social Competence ? 


Sunmar 
2nmary 
1) The upper fou 


rteen and lower fourteen 
groups as found byt 


| һе Composit:- Score of | 
Supervisory Ratings had mean differences in 
which the upper group appears higher in all 
Measures of soc 


ial competence, 
2) It can be Observe 


Teacher 8, D.s. 
exists betwee 
Student S. D, 

4) Higher rating 
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> groups 
ion of selection of Upper and Lower К росы 
was based on the Recording mage | manas 
sional Con:petencies). In two of ыы 
ures of Social Competence, the Y^ К p. Ë 
Teacher S. D.S. (Subject) and юэ хөв: паа 
(SI score), the group of fourteen Теа: 
cessful teachers rate higher. fourteen 
5) Over-all comparisons of the Fen ba 
most successful teachers and the 
least successful teachers on all oar and for 
ures of Social Competence are mae he сош7 
all the criteria of teaching pem teachers 
parisons are mado between nieto and the 
comparing ihe first most xa by the next 
least successful teacher followe xt least 
most successful teacher and the T that the 
successful teacher, etc. Data speed ina 
upper groups of teachers were 5” compari” 
Social Con.petence measures (22 lower grou 8 
sons) by twice Ше amount as Ше ог groups 
oi teachers. Both upper and lower 
were equal in 55 comparisons. 


ven meas” 


Conclusion ifforences be 
There exist definite mean аш | and four 
tween the fourteon most successil Өл о 
teen least successful teachers in ce scores 
of the twenty-eight mean differ = 
in measures of Social Campe е | 
The upper group appears to сэн 
nearly ай cases with four Tame or by 
exceptions can probably be рту іп m 
the fact that in each case the цэнгээн! crite 
volved, either the particular tea ca 
Y tudY 
e 


“чета, 

Та ог Ше social competence pen this 5 
Гог self-evaluation by teacher uation? alg 
tends to point out that self-eva де the те 
the least consistent and reliable ach 

res . rteen ёй, 
у T should be noted that the peat w үз 
composing the upper and lower егей dt 
different persons or occupied. oh of the У 

in the respective groups for d Тай. 

ious criteria of success in teachine 


28 
š 3 dged га 
- Is Ше individual teacher who is 1962 сүл 


: te : 
either most or least successful ын м 
also rated correspondingly үн modifi 
Social competence as found in 
Sociograms ? 


20 же gh 
judged to be the three most ks teacher у sue 
ers in the investigation, while the t 
bers 2, 45, and 47 appear to Бе ділі A 
cessful. Modified sociograms 5 elatio” sf 
teachers’ social competence pes clas? 

their teaching colleagues and aoni бай 
their students are found in sectio? “сор 


on Дір 
Tables VII and VIII, Section 
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m also showing the three most and least 
man e teachers compared in percent for 
how Second, and third social competence 
of Ts received from the staff andone class 
бі хон students, The average grand total 
hy the соо competence choices received 
10, 40; ree most successful teachers was 
teen ан the three least successful 
тата Зе received only 0.98%. The average 
Choice pes of student social competence 
ful ср емен һу the three most success- 
Succes ers was 12.9% and the three least 
essful teachers received 7. 4%. 


Conclusion 


шалы most successful teachers appear tobe 
сезар ia У competent than the least suc- 
eagues eachers according to both their col- 
Е Students. However, Ше most 
Sociall ul teacher is not necessarily the most 
ар рога, competent person in his teaching staff 
тот ane to the modified sociograms made 
What ext, ings of colleagues and students. To 
ВЕБ ent the more successful teacher can 
group ig «Ally competent than others in his 
Successr not known and to what extent the least 
notas ul teacher is socially competent is 
Certained in this study. 


10. Is the 


Inga Si 
tween Е 
Р 


variable of length of service in teach- 
Enificant factor in the relationship be- 
Осїа1 acceptance and success in teach- 


Ing? 


Summary 
occupa vice teaching has been the major 
Е: ion 5 Source of income from their 
ti te for all of the people with ex- 
та ші teacher numbers 7, 9, 29, 30, 42, 
9m teachi Each of them has been амау 
ахі шо! for а period of time up to 2 
College ОГ four years between their date of 
Biven го a duation and 1952. Тһе reasons 
Other o T this were military service, illness, 
of in-s Cupations, ек. The maximum length 
done АНЫ teaching any of the teachers Ваз 
from p, уе years and all of the people vary 
teachers. maximum down to being first-year 
е cle; (Table Ш, section II, shows this 
Dh о arly.) There is по general pattern 
teachin "nd in comparing length of in-service 
Sueco S vith Success in teaching. Botha 
3 уе ul and unsuccessful teacher сал eq 
= ехре Опе, two, three, five, ten, etc., years 
While apa and one can be judged effective 
Le Other is judged ineffective. 
be а ah of hes teaching was foundto 
Socia] Eligible factor when compared with the 
Parent 2—Серіарішу of the teacher and по АР” 
tween tnelàtionship can be established be 


e 
Se two factors. 


Ír 


ual- 
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Conclusion 

Length of teaching service does по: ap- 
pear to be a significant factor in the relation- 
ship between teacher efficiency and social 
acceptance. Teachers of varying lengths of 
service fall both in the most successful and 
least successful groups without any seeming 
pattern or apparent reason. Teachers who 
have an equal number of years in serviceare 
found to be designated with equal alacrity as 
both most successful and least successful re- 
gardless of the same time lengths of exper- 
ience. 

The three most successful teachers, num- 
bers 11, 14, and 20, who are socially well- 
accepted by their colleagues graduated from 
the University of Wisconsin in 1948, 1948, 
and 1951, respectively. The least success- 
ful teachers, numbers 2, 45, and 47, whoare 
not socially well-accepted graduated in 1949, 
1949, and 1952, respectively. This tends to 
amplify the fact that both relatively good and 
poor teachers may have approximately the 
same length of time in service and still vary 
widely in the degrees of teaching efficiency 


achieved. 


General Conclusions 


The investigator in this study has attempted 
a relatively new sort of evaluation of the teach- 
er from which an educational researcher and 
practitioner may be enabled to obtain further 
measures of his professional and social com- 
petencies. These competencies especially em- 
phasize the social aspects relevant to how the 
teacher conceives of himself and his role in the 
school, and how colleagues, students, and other 
persons appraise him in that role as teacher. 

The basic question which was raised earlier 
in the study was what constitutes anadequate 
eria of teacher efficiency. It was wondered 
lf-evaluations, student ratings, ex- 
s, and the relationships found between 
de adequate measures of the teacher's 
effectiveness, ог whether these techniques (used 
in conjunction with modified sociometric tech- 
niques), audio-recording ratings of classroom 
teaching and self-rated social introversion and 
competency measures taken from a personality 
inventory might not yield further and important 
measures of the teacher’s efficiency. The basic 
question and its sub-question have been answered 
to some extent by the results of this investigation. 
The use of instruments and techniques in the 
area of social competency with its aspects of 
group acceptance, group structures, group in- 
teraction, and individual social adjustment 
would appear to have proven fruitful in the 
search for more adequate criteria of teaching 
success. The instruments and techniques of 


crit 
whether se 
pert rating: 
them provi 
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investigation employed provide the educational 
researchei, teacher training institution, school 
administration, and the teaching staff with 
means whereby a more well-rounded descrip- 


tion of the teacher and his effectiveness may be 
obtained. 
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TEACHER ATTITUDES TOWARD CURRICULUM 
CHANGE: THE EFFECT OF PERSONAL RELA- ` 
| TIONSHIPS ON THE DEGREE OF 
FAVORABLENESS 


EVELYN I. BANNING* 
Harvard University 


Introduction 


sis ра LONG been recognized that the 
Change Тэ е are central to curriculum 
lum one mu 2 ), and that to change the curricu- 

о ünderstza. change the people that operate it. 

iel (41) u то Ой Сап as professional workers, 
teacher шаг icated the importance of knowing the 
and weakness, е with its characteristic strengths 

пке, O ra, for determining the mode of 

teachers he principles that the attitudes of 
Which they be] their anchorage inthe group to 
а social гж elong and that curriculum change is 
in which жы developing out of the situation 
ulated the Бл Ene are working, the writer form- 
namely piel dg hypothesis of this research; 
uation deter: interaction within the teaching sit- 
orablenese 18 the favorableness and/or un- 

а the pres, 5 of teacher attitudes. 
Ч дез е experimental study of social at- 
teacher я in an attempt to determine 
the loca itudes toward curriculum change at 
ited to Е ate level. The researchis lim- 
School с + attitudes of sixty-five junior high 
Communit SSroom teachers іп a New England 

he testi, ОГ approximately 50,000 population. 
Cala ini locale was selected because the lo- 
депу у En tative and teaching staff had been 
high cheat е for several months in junior 
хе tee года пи revision. i 
act pm plications for curriculum de- 


nt were ñ 
cons 227% 
research: nsidered preliminary to the 


1. т, 
he aq. 

Statu “ministrative and supervisory staff as 

а better aders might have a means and be in 
lo ` мып to facilitate curriculum de- 


Clea 

+ rer i " 

Ings г insight into the teachers’ own feel- 
increases Curriculum спапье might lead to 

3. teacher competency. 


е invests | 
the рај SStigation of teacher attitude within 
tery; Шаг organization was likely to de- 

readiness of change. 


Purpose of the Study 


The purpose of this exploratory study was 
two-fold: (1) to determine, insofar as possible, 
the favorableness and/or unfavorableness of the 
attitudes of the sixty-five junior high school 
teachers; and (2) to relate the degree of favor- 
ableness to selected variables within the teach- 
ing situation to discover to what extent these var- 
jables were positively related to favorableness 
and to what extent they were the causes of resis- 


tance to change. 


For reasons of objective research, the term 
attitude is defined in this study as a ‘delimited 
totality of behavior” (60:51), not as something 
that predicts behavior. It is used interchange- 
ably with opinion, with the distinction that atti- 
tudes include opinions (verbal responses) and 
consist of both verbal and non-verbal responses. 
Since the writer is dealing with verbal ‘‘behav- 
ior, " frequently classified as opinion, this study 
is restricted to verbal responses observable 
through questionnaire and interviewing. The ‘‘be- 
havior” of interest to the investigation is the re- 
sponse of individuals to questions which belong 
in the universe of curriculum change, the con- 
cept being investigated. This concept does not 
involve a specific change nor proposed curricu- 
lum organization toward which change is direct- 
ed. Curriculum is thought of as a process, not 
as a body of content; curriculum change, viewed 
as a type of social change becomes, therfore 
largely a matter of discovering and applying Бев 
{ег procedures for improved learning experiences 
{ог pupils. 


Methodology 


Anattitude scale was first dra. ; " 
based on the literature in the eed: а 
change, together with as complete a knowled гүй 
and understanding of the local teaching А 
as possible through direct observations, ud 


Ж 
aduat, 
9 School of Education 


э 
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ings, informal talks, and study of the organiza- 
tion of eazh junior high school unit and its func- 
tion within the system. The scale conta ined 
questions about which the teachers, already in- 
volved in curriculum revision, might be expect- 
ed to have attitudes and opinions. The thirty-one 
items covered the following points: estimation 

ої the present curriculum, administrative lead- 
ership, teacher responsibility, methods, source 
and result of change, interest in curriculum plan- 
ning, freedom: for classroom teaching, and е!- 
fect of the curriculum study on the total school 
System. To each statement on theattitude 
Scale was added the question of intensity of feel- 
ing: “How strongly do you feel about this?’ with 
answer categories of “Not at all strongly", 
“Not so strongly", “Fairly Strongly", “Уегу 
Strongly", and “Мо answer", Re»eating this 
question after each content item yielded a series 
of intensity answers. 

For measuring the interaction oi teachei > 
within the social structure of the six junior high 
Schools in the school system, factors within the 
"teacher culture" were Selected as independent 
variables. Factors in the Situation to be relat- 
ed to the degree of favorableness or unfavor- 
ableness of teacher attitudes in curriculum change 
were the variables of the social Structure of each 
of the six junior high school units, These vari- 
avles included group relationships among mem- 
bers of the School, teachers, pupils, and admin- 
istrators; the status of teachers in the school 
and in the community; teacher expectations with 
respect to curriculum values, extent of accept- 


ance of teachers by others as participating niem- 


bers of the total group; and opportunity for sug- 


gesting curriculum changes. In additionto these 
independent variables for measuring the situa- 
tion, the variables of age, Sex, and professional 
training and experience were selected for deter- 
mining their influence, if any, on the relation- 
he teaching groups. 

of the Teacher Attitude 


Assumptions Underlying the Study 


Several assumptions under 
Study of teacher attitudes аз 
2n attitude scale ang by pers 
It is assumed that what teachers s 
is actually what they believe 
was used ina situation ; ! 


lie this present 
measured both by 
onal interviewing, 


victions and opinions, 


the individual responses in th 
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Íree and complete expressions of uie, E 

validity of verbal responses is the basic peras 

tion of the measuring devices used in юэ Е 
Murphy and his associates support the уа 

ity of test content as follows: 


Actions are no more inherently ‘val- 
id' in the first place, than words. rs 
following remarks seem to us цалин ГЭ 
true: Actions are frequently designe 5 
distort or conceal ‘true’ attitude цамцаа 
fully as verbal behavior.. e AM pe 
ior is subject to n.odification in the р а 
cess of execution from хэрэг impero 
courtesy, expediency, or other soc em 
pressures. And it is furthermore Ey 
ent that when verbal behavior is use 
distort or conceal the ‘true’ attitudes, 
the distortion con.monly conforms ке -— 
everyday behavior. The reasons for ал 
cealing ‘true’ attitudes are the wo 
both verbal and ‘overt’ behavior. Е. 
ditions of secrecy, and preferably — 
anonymity, are observed, there 15 ы 
reason to expect free and complete p 
pression of attitudes through жин, хэн 
Íreed from social pressures, than > 
behaviors which are open to all БА a 
ers.... And, finally, it may be 005 24 
that a man's categorical agreemet" i 
disagreement with a rather strong n m 
ed opinion about the Chinese, or еы 
Rotarians, or Communists, is me eni 
day life regarded (if the man is sinc 
аз а significant part of his желет 
There seems to be no reason why t + 
behavior should suddenly become D 
Significant when it is made the БУУГ 
of careful inquiry, particularly if ш: 
of insincerity are reduced to a min 
(44:912) 


Whether or not a person acts in 19 
with his attitudes is a question apart teacher 
measurement and definition. That а ^r vor 
favors curriculum change and Шала y that 
able opinions concerning it does not No опет(0 4 
he will work to bring about change. express? _ 
one correspondence between verbally ted of im 
attitudes and actual behavior is indio teme 
plied. Since the study is limited to SA bo pe, 
of what the individual claims his attitue’ je" 
it is recognized that the methods аге Poo con 
ly to be valid if teachers have no той 
ceal attitudes, 


Ranking of Respondents on Scale 


ity 
;ntensi 
Both the content questions and the Баг а 
questions were scored according to V (con^ 
Weights. The categories of the attitu 


December, 1954) 


кап чс шы were given weights beginning with 
авн г question, the higher weights were 
Зони о categories judged to express a more 
5. le attitude toward change. 
арт the scalability of the universe of cur- 
октап nes sa the Cornell technique for scal- 
a релде ysis was used (24). The technique, 
ны Гог testing the hypothesis that the 
first de 15 а scale for a given population, was 
veloped for teaching purposes at Cornell. 


for The VEO is said to be scalable 
Е Population if it is possible to rank 
n fue from high to low in such a fash- 
Càn rep ш а person's rank alone we 
items produce his response to each of the 
та simple fashion. ’’ (24:249) 


oon. гезропвев of the total sixty-five class- 
Were observed in the junior high school units 
е gener ы on the thirty-one items covering 
lu al content of attitudes toward curricu- 
Were ма Two approximations, or trials, 
Scalability 9 reject or accept the hypothesis of 
Teproducibinne first trial indicated an error 
Percent of th ility, considerably more than 15 
the number 19 2015 responses (2015 = 31 x 65), 
People, of questions times the number of 
To 
By ih error, categories were combined 
Within the -Dining the overlapping of the scores 
Bories 1 columns of each question. When cat- 
Imize t i ?rtwined, they were combinedto min- 
inatione “ГОГ of reproducibility for the com- 
Bories, а Оп Ше basis of the combined cate- 
а а trial rank order was establish- 
Scored рл ning weights, Each scale was ге“ 
e т new tables made. 
"i than in th 9f reproducibility was muchsmall- 
na top sey е first trial. In question 1, six of 
teVenteen en Scores were made by six of the top 
ial, ңор ОР1@ as opposed to two іп the first 
tattered re the remaining scores were 
t » Cutting length of the column. In each col- 
ine the pes Points were placed so as to mini- 
of the у Sle oe The total number of errors 
съ the p table was 505, which was 25 percent 
pectic 1 sponses. In terms of combined cat- 
ћ 168 атс. universe was found to have only 75 
thee a iain for reproducing a response 
те Was п | S rank order. Since apparently 
мц, tent ue Single ranking possible inthe ке. 
Зла 2 (0 break Ин by the scale, it seemed wor 
орта nalyze th e content down into sub "nes 
аты уз Sub-areas separately by 5са эй 
to Outside ` Thus the relationships ofa su 
т Se are € variables could be studied И апу 
ig Ihe tota cS Were found scalable. | 
Чаек о tive’ or universe, was therefore Ше 
tions 176 Sub-areas, made up of five or SPE 
ch, and scaled according to the Cor 


10 


bh _ 
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nell technique used for the total scale. The 
five sub-areas selected for scaling were as fol- 
lows: ! 


1. Attitude toward teacher responsibility іп cur- 
riculum change 

2. Satisfaction with the present curriculum 

3. Attitude toward effecting curriculum change 

4. Attitude toward the administrative leader- 
ship in the curriculum study 

5. Attitude toward the value of curriculum plan- 


ning 
Selection oí the Scale 


Since the error of reproducibility of the 
scaled sub-areas on attitude toward teacher re- 
sponsibility and attitude on methods of effecting 
curriculum change was greater than .10 (. 19 
and . 13 respectively), they were rejected аз 
scales for measuring the favorableness of atti- 
tude toward change. Although the three remain- 
ing sub-areas scaled with a coefficient of repro- 
ducibility higher than .90, the six items of the 
sub-area on the value of curriculum planning 
were judged by the writer as more indicative of 
attitude toward change in the teaching situation 
in the junior high schools than the items on sat- 
isfaction with the present curriculum and on ad- 
ministrative leadership. This selection was 
made, as was that of the original set of thirty- 
one items, by the subjective judgment of the 
writer with full consideration of the given popu- 
lation and the time sequence. 

For several months prior to the administra- 
tion of the original scale, the teachers had been 
actively engaged in curriculum revision through 
group meetings. Іп addition, the administrative 
staff had directed the thinking of the teachers, 
through an unsigned questionnaire, concerning 
the principles and practices of the curriculum, 
broadly conceived. Through these experiences, 
the junior high school teachers had been con- 
sidering curriculum change as an on-going pro- 
cess of change with no preconceived specifics 
and no proposed curriculum organization toward 
which change was to be directed. Consequently, 
it was the writer's contention that the general 
content items on the opinions of teachers about 
the value of curriculum change as a process 
would measure the favorableness of teacher at- 
titude within the local situation more effectively 
than the other items in the two scalable sub- 
areas. 

Since the teachers were already involved in 
curriculum revision, it was unlikely that teach- 
ers would indicate a completely negative response 
on the question: “АП things considered, do you 
think the present junior high school curriculum 
is about as satisiactony as possible?” Actually 
the response “Completely Satisfactory”? was 
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unused, thus necessitating re-weighting of the 
categories by its omission. It was also appar- 
ent to the writer that the content questions on 
Satisfaction toward the present curriculum lim- 
ited the responses to specifics such as choice 
of subjects, courses, and facilities and equip- 
ment. Therefore, although the sub-area scaled 
with a . 91 accuracy, it appeared too restrictive 
in subject Coverage to measure the concept of 
curriculum change as a process. 

The sub-area on attitude toward administra- 
tive leadership was likewise considered too lim- 
ited in content to measureattitude toward change, 
although the writer recognized that teacher atti- 
tude toward leadership and administrative pol- 
icies might be related to change and might be a 
factor in determining change. 

Of the original thirty-one items, the six it- 


higher than either of the other two Scalable sub- 
агеав. It not only had the highest coefficient of 
reproducibility (; 93), but the range of marginal 
frequencies was evenly distributed over all the 
categories, and the scatter of errors in each it- 
€m was random. Thus, it conformed best tothe 
Scaling features of the Cornell technique, 
Since it was believed that tke two Scalable sub- 


Attitude Toward Value 
— ard Value 


U F 
T]. 
23 42 


Dissatisfied 


Satisfied 


їийг 


| 65 


ity of occurrence оға chi 
than . 05 if the hypothesis ге Of 5. 09 is less 


with the prese 
degree, gi 


related to Some. ht 
Sponses Showed ag егеси of 


all sixty-five ге 


(Vol. 28 


tween the attitudes expressed on the two scales. 

The relationship between the attitude toward 
administrative leadership and the value of cur 
riculum planning was as follows: 


Attitude Toward Value 


U Е 
Attitude 7 30 
Toward 29 
Leadership 16 13 a 
ам | 


The hypothesis that attitude toward cn] 
istrative leadership is independent of the Means 
of curriculum planning was also tested by im 
of chi-square. Since the probability of ос lii 
rence of chi-square of 7. 47 is less Шап. re- 
the hypothesis is true, the hypothesis wm at" 
jected. Therefore, the data indicate me aq 
titudes expressed on the two scales relate ixty^ 


the 
Е attitude 


isfaction with the present curriculum, 
who express ап unfavorable attitud rable at 
change tend to express an equally unfavo atisiac™ 
titude on administrative leadership and this reas” 
tion with the present curriculum. УШ niui 

Оп, only the scale on the value of TUEN riable?: 
planning was related to the interview Сат or 
Since this independent variable was the ndings 
concern of the study and since similar relatio? 
might be expected of the other scales in 

to the interview variables. 

Table I indicates the questions and {те 
of responses for the six items used in is sho 
The scale analysis for this scalogram 1 
in Table II. 


Intensity Function 
e 


b 

To determine a cutting point that wot con" 
meaningful with respect to the whole 5' tensit 4 
tinuum, the two-part technique of the = ш 525) 
function was used. Тһе fold-over m 25 
been previously rejected, since Stouffe ерага! і 
Stated that it would seem safer to use сз isti? 
intensity questions, which would call fo ent. №". 
and separate decisions from the үезрер вех 
the two part technique, intensity scora score? 
Регітепіа Пу independent of the content 9? 

Use of the intensity function obviate ja yield 
Problem of question bias, in that it wow rable 
the same proportion of the group as fav Г 


е towar 
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TABLEI 


ATTITUDE TOWARD THE VALUE OF CURRICULUM PLANNING 


Number of 
S 
cale Item Question Frequencies of Response 
1 Ч Do you usually feel that what you are doing 
in the curriculum study is worthwhile or 
not? 
Favorable 45 
Unfavorable 20 
e 9 How interested are you in your part in cur- 
riculum planning ? 
Favorable 43 
Unfavorable 22 
3 20 Do many of the pre-planning activities in the 


curriculum study seem important? 
Favorable 9 


Unfavorable 56 


E 77 7 72 7 27 7 7 7 7 7 77 ны 


21 How do you feel about the importance of cur- 
riculum study as compared with other work 


you might be doing? 


Favorable 35 
Unfavorable 30 


о а аана UEM 


27 Do you have time to be active in the curriculum 
study and still prepare for your teaching to your 
own satisfaction? 


Favorable 17 
Unfavorable 48 


Б-г == s. Ea 


У Do you feel that Ше present curriculum study 
31 noose : 
for the junior high schools has value for the 
total program of the entire school system ? 
Favorable 60 
Unfavorable 5 
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TABLE H 


SCALE ANALYSIS FOR TEACHER ATTITUDE SCALE 
SECOND TRIAL: CONTENT 


2 


Score 


И О AX AX KKK KKM KKK a W 4 4 4 W ра ра a 


KKK KKK KKK OM KOM MO KR KR XX X X X X x W X XX NX X X 


WO KK MK KKK OM KOM OM XX м м 


MOX OX И OX X W XXX M XXX 


ди OX OX RK MMM W OM OM W MRK x x MM x x x x X KK KK x 


KM KKM X X XXX X W W W W W OM жк жк OR OO OO OO OO NONO OX ox NX 


MOM MM к м х x 
м кк MOM OM OM OX MX 
кини ЈЕ ЈЕ ЈЕ MMMM MK OO кккккккиккк 
кик M мм 
KM MMM MM KK MM OM MM OM MO мм м NOM M M M MM кккикккк 


соссосососоососососос ә cO cO cO cO co «H < < <H <H и <H SH 
SSS До үч хэ о О Ф 90 оо со со оо оо co co со со со co оо со со co «o cO co co co cO co хи 
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1 
Mun 2 2 3 4 5 6 
е 0 2 0 2 0 2 0 2 0 2 0 
х 
4 х х x : 4 5 х 
| x А х х х x 
3 % " х x x х х 
i M x x x x 
+ * х x x x 
2 3 х Ж х х х 
: 5 х x x x x 
: 5 х < x х х 
2 = 56 x x x x 
5 к х х х х ж 
a Е х х х х 
Š x: x x х х 3 
~ х х х х 5 
Ете- ü 
quency 4 
5 20 43 22 9 s 35 30 и а 60 5 


TABLE Ш 
PUPIL-TEACHER RELATIONSHIP* 
Attitude Handling Individual Disturbances 
Toward Through Through By Class Rec- 
Change Individual Pupil ognition-Teacher | Number of 
v Help Assistance Authority Responses 
Mavorable 24 22 52 di 
Еауо 
rable 
76 78 48 
ma UL 
Қы 
°5ропзев 29 9 27 
65 


ни 


* 
Data 
reported in percentages. 
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TABLE IV 
ADMINISTRATOR- TEACHER ВЕГА TIONSHIP* 
Channels of Communication 
i = прег 
Attitude Outside Leaders | Superinten мэ 
Toward Consult- Within Individual dent to Responses 
Change ants System Teachers Principal 
23 
Unfavorable 0 29 33 44 
42 
Favorable 100 71 67 56 
100 100 100 100 
Total 65 
Responses 2 17 21 28 
*Data reported in percentages. 
TABLE V 
COMMUNITY ACTIVITY* 
er 
Attitude Not Nus? 
Toward Very Fairly Very Not nses 
Change Active Active Active Active Respo 
Unfavorable 0 29 46 60 23 
Favorable 100 71 54 40 42 
100 100 100 100 
Тоїа1 5 
Responses 8 24 28 5 6 


*Data reported in percentages, 
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а нсие, по matter how the questions 
was. sha what the position of the question 
tion of the hat order was used in the presenta- 
tive meth bo iae categories. Thus this objec- 
attitudes od offered an invariant zero point for 
possible "tt It is based upon the concept that itis 
People at qu E the intensity of feeling which 
titudes pus erent scale positions hold their at- 
“тешган: Such intensity marks off a point of 
group tnte бар к. provides a division of the 
ег negative, ctions, one positive and the 
rcm E thirty-one content questions 
on the strengt attitude scale, a second question 
Strongly q ngth of feeling was added, “How 
Bories inel you feel about this?” The five cate- 
(“Very н degrees of strength of feeling 
Strongly one уы? “Fairly strongly, " “Not so 
answer») = ‘Not at all strongly, " and “Мо 
» in that шэг assigned weights of 4, 3, 2, 1, 
Scores fiie er. The first trial of the intensity 
Categories ман that dichotomization of these 
СМ weight might give а quasi-scale of intensity. 
ly" an 0 стах assigned, 2 for “Very strong- 
Intensity oe all other responses (60:253). The 
"pon the Howe ranged from 0 to 12 depending 
teacher umber of answers about which each 
h felt Very stronel 
9 lowest poj E. к : 
lell ара point, a very definite zero point, 
;Micateq ATA The sharpness of the curve 
utra]? in үсе were few teachers who were 
manning for eir attitudes toward curriculum 
ratio of Change in the junior high schools. 
€ness to approval to disapproval, or favor- 
Әле to three utvorableness, was approximately 
Ь Clear distin € а very sharp curve showed 
m 1 negative ion between being positive and 
хад region ati The low point was in the nega" 
i €acher he content continuum, showing 
п Opposed 5 in favor of curriculum change 
The cu to its planning. 
9n the giv V€ Obtained for an intensity function 


On th 


i s : 
bee гена е cases used seems to differen" 
th th Ses between positives and negatives, 
өр to the ed that it is safe to say that, accord- 
{ау Ве и. of junior high school teachers 
fop Table attit attitude scale, 65 percent held a 
fay, Vricul itude toward the value of planning 

ire um change, and 35 percent held un- 


1 я 

ning, е attitude toward such curriculum plan- 
ten 9lloy; 
а Views yng twelve identification codes, the in^ 
Org үү 161060 forty-seven items dealing with 
Correlat teaching situation. Each variable 
тіс her Abe with the attitude score of the 

Ulum ру чае Scale Toward the Value of Cur- 


nning (see Table D. Owing to the 
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limited number of categories for the small рор- 
ulation (sixty-five teachers), four-fold зао1е5 
were used incorrelation. The chi-square test 
of independence was first applied to each 2/2 
table to determine, in advance of measuring the 
degree of correlation, the significance of the 
correlation as a chance departure from zero or 
no relationship. To the tables that showed a 
probability of .05 or smaller, the Yates соггес- 
tion formula for continuity was applied. Thede- 
gree of correlation was then measured by tetra- 
choric correlations, computed by the manual i 
for the corrected chi-squares with a probability 


not larger than . 05. 


Group Relations 


Within the teaching organization itself, three 
relationships were tested: pupil-teacher, ad- 
ministrator-teacher, and teacher-teacher rela- 
tionships. Responses to interviewing were the 
determining factor for these group relations. 
Pupil-teacher relationship was judged by the in- 
troductory interview questions, since it had been 
noted in the pre-test of the interview that teach- 
ers generally responded with less restraint and 
more rapport when the initial question concerned 
pupil relations with other pupils. | 

When chi-squares were applied to the inter- 
view items concerning pupil-teacher relation- 
ships, it was found that one item differentiated 
between teachers favorable and unfavorable 
toward change. Пет 3: “Іп general, how do 
you handle pupils when they want to do some- 
thing you feel is disturbing to the group?” re- 
vealed a correlation between attitude toward 
curriculum change and teacher-pupil relation- 
ships with classroom activities. 

Teachers who indicated that they handled each 
adjustment problem individually through person- 
al guidance or help in class time were general- 
ly more favorable in their attitude scores. This 
situation WaS also true of the teachers who rec- 
ognized the status of the pupil among his peers 
and arranged a classroom working relationship 
advantageous to both the individual andthe class 
group. 

With a chi-square of 4. 31 the hypothesis that 
elationship exists between pupil-teacher ге- 
lationships in classroom activities andattitude 
toward curriculum change is untenable. 

The significant pupil-teacher relationships 
concerned the attitudes of teachers toward the 
handling of pupil-adjustment problems in the 
classroom. Favorableness toward change was 
related in a positive degree to the tone teachers 
maintained in dealing with individual pupils who 
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еге (Chicago: University of Chicago: 
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Computi Diagrams for the Tetrachoric Correla- 
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disturbed the planned group activity. Consider- 
ation of the disturbance as an individual matter 
to be adjusted according to the benefit and edu- 
cational growth of the pupil rated teachers more 
highly favorable than other approaches. In par- 
ticular, the teachers who felt that class disturb- 
ances could be automatically handled by dismis- 
Sal from the classroom, by removal of privi- 
leges, or by reprimand before the class in or- 
der to retain teacher authority were generally 
more unfavorable toward curriculum change. 
Teacher relationship to administration show- 
ed a significant difference in respect to the de- 


termining of curriculum policies for change. То | 


the question: “Во you feel that teachers have 

a real part in determining the policies of the 
curriculum ?” teachers indicated the channels 

of communication by which they felt the policies 
were determined. These responses differenti- 
ated to a real degree the favorableness and un- 
favorableness of teacher attitudes toward change. 
The teachers who felt that communication wasa 
formal channel from Superintendent and princi- 
pals to the teaching staff with little return com- 
munication evidenced no difference, but teachers 
who recognized individual responsibility and as- 
Sistance of leaders, either outside consultants, 
or directors and Supervisors within the system, 
were more favorable toward change, 

Items 1, 2, 3 were combined into one vari- 
able of non-formal channels of communication 
in order to relate formal and informal channels 
to favorableness of attitude toward change. The 
relationship was studied by means of the chi- 
Square test. The obtained chi-square of 6.16 
Showed that there was а probability of .01 that 
а relation Ship existed, 

Favorableness of attit 
related Significantly with the feeling that the 
teacher was а realpartic 
of curriculum policy, an 


Ship in the curriculum study, 


It seemed evident 
on of teachers 


and administra- 


to change and those 
ity within the life of communi i 
indicate a Somewhat ши? ever, ox 


Significant difference, 
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To the extent that teachers were ми 
ly active, the degree of their асе 
ward change increased. Teacher r не я 
were easily ascertainable оп the item 0 + tels 
ity, for teachers felt very strongly = des 
own community participation. Моп-ас = де 
chers explained their reasons for een n 
Stated their feelings about the questione coding 
of additional out-of-school activities. 10 юм 
items for teachers who indicated vA еп ше 
participation in organized community Е: ups 
writer considered membership in four gr 
as average. 2 

pr probability of slightly ep 
than . 05, it is possible to state that НЕН ҮТҮ 
tionship exists between degree of BH 
activity and attitude toward dime concern^ 

The opinion that teachers expresse пп У» 
ing their activity in the life of the commi scale, 
when correlated with scores onthe Log а 
Showed а significant relationship. The т ating 
belonging to the community as a partic D ticu- 
member rather than membership in a eater 
lar kind or number of civic, ele “ёс 
al, or professional organizations Show ther 
lationship to favorableness of change. ils out? 
ог not the teacher had contact with pup! S үд - 
Side.the school seemed not to affect suc ac^ 
tionship, but if teachers felt that they they 
tive in the adult life of the comm aide on 
tended to express a more favorable a 1 teachers 
the scale. АП of the junior high | er шесі» 
included in this study stated they lived ^.» res” 
yet 51 percent felt that, although they ciively 
idents of the community, they did not à 
participate in its civic life. 


Patterns of Satisfaction : 
А іем5› 
From Ше total responses of the interv erns 
it was possible to discover шет ШЕР, ner? 
ОГ dissatisfaction or satisfaction of Ee garric"? 
toward the present junior high pem wi 
lum. In correlating the coded varia tisfactio? 
these patterns of dissatisfaction or pe 
with existing conditions, the writer d: sex and 
factors that were significantly relate enty men 
Pre -appointment training. Of the € а feel” 
teachers interviewed, 80 percent sta currit" р 
ing of dissatisfaction with the existing 6! ў ші ag 
lum. Women teachers, оп the other ed a feel 
more frequently (42 percent) apra indicat? 
of satisfaction. A chi-square of 6. pam one n 
that there was a probability of less ce was га 
Chance in a hundred that this differen 
dom. 


n 
Graduates of liberal arts colleges 2 


+ 


а uni 


2. Florence Greeuhoe, "Тһе 


с қ 
ed as a National Semele, Ommunity Contacts and Parti. 


" School and Society, (Octobe: 


cipation of 9,122 Public-School Teac 
T lh, 1939), рр. 510-512. 


” 
jere gelet? 


December, 1954) 


versities generally felt more dissatisfied with 
Conditions than teachers who had received their 
Undergraduate preparation at state teachers col- 
eges. There was a marked tendency for grad- 
rates of other than state teachers colleges to 
feel dissatisfied toward the present curriculum 
and to indicate a greater readiness for change 

П Was indicated by graduates of the teachers 
ae вез. Degree status, or course credits and 
Gao received since appointment, did not af- 
Shi he ratings nor show a significant relation- 

ІР With feelings of dissatisfaction, indifference, 
Ог Satisfaction, 
нај interview responses also yielded evidence 

t Willingness to be active in curriculum change 
sation ressed by as many teachers who were 
Misses WR conditions as teachers who were 
ingne: isfied. Teachers who indicated such will- 
ues di Were generally favorable toward the val 
correlate eration. Highly significant was the | 
riculu JP Of Willingness to exert effort for cur 
OWard | change with the favorableness of attitude 
Teache integration for classroom experiences. 
Нуе нэ Who recognized the importance of un- 
erent;ateq ЛЕ experiences for pupils were dif- 
Pinion tha rom those who had conveyed the о 
ject, Sho 
Chers ка 
Change i 


t subject content or a particular sub- 
Ша be taught as а separate area. Tea- 
аду to take an active part in effecting 
More у, N the curriculum generally felt that much 
lences E Че accrued to the pupil through exper- 
lines a activities that cut across subject 
Among tra tough separate subject matter. 
Currieulur teachers interviewed, readiness for 
Convict; um change appeared to be related to ће 
inelugeq T that educative experiences should be 
integratien the Curriculum on the basis of their 
and tha; үе Values for junior high school pupils, 
Apart £ ПО Subject should be taught in isolation, 
rom the interrelating whole. 


R 
£Sults of the Stud 


рог Fesults of the findings indicate the im - 
Ate нь, 12; the ability of teachers to uc ca 
nicati ~ necessity for clear channels of con 
Tom = both within the teaching units and — 
tratong nens to administrators and from ста 
° direc Ю teachers, More essentialthan that 
(O"Drin СЕ line of communication from teacher 
DWo-yACIPAl-to-superintendent be used is that a 
Teaches” Process shall be continuously main Эн 
by the Г 5 need to understand the decisions mea 
th. Se dministrators for promoting changes h 
the 001 Curriculum or school organization Ё 
accept responsibility for making ^^ 
Contributions. The way teachers гэн 
и Cision is more important than ын үзі 
Without the favorable аш ie 
гају d their active personal inter en 
ive members of the group, hans 


tained. 
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curriculum seems likely to be superficial or at 
least temporary. | 

Parallel to Ше need for formal organization 
with established channels of communication is 
that of the opportunity for teachers to share in 
cooperative group action. Such action necessi- 
tates a situation so clearly structured that each 
teacher would feel secure and free to partici- 
pate in the organization. Promoting this kind 
of cooperative activity requires, too, the kind 
of atmosphere that would permit and encourage 
all teachers concerned ina problem totake part 
i ing it. 

7 po» expression of pupil-teacher rela- 
tionships in this study, the writer has been led 
to conclude that harmonious relationship w ith 
pupils is largely determined by the ability of 
teachers to think in terms of the culture—the 
way of life—of his pupils. Even when the rela- 
tionship involved considerable conflict or осса- 
sional strong antagonism, many teachers indi- 
cated with apparent honesty that they saw no 
reason for treating pupils as individuals, that 
all children ashould have the same treatment. 
Many who recognized the theoretical value of 
experiences suited to individual children re- 
called their own experiences 1n the classroo шы 
embering по occasion when they had receive 
гийн idual attention. Expectations of the class-. 
pue ere the same for all. Thus having their 
хань h one culture some teachers were finding 
it uncomfortable to adjust to another. 
! the other hand, there were teachers who 
doatred to apply the principle of individual dif- 
ferences but lacked the necessary support and 
encouragement from the supervisory or admin= 
istrative staff and were therefore fearful of mis- 
si боов endin by other teachers. Unless both 
administration and teaching staff recognize to 
а eater degree the value ofa positive approach 
= үй lping pupils develop cooperative skills for 
а Paving revising the curriculum may well 
etn to mean mere courses of study and ma- 
terials to be covered. Of more importance for 
curriculum change than teaching load, size of 
lass, or free time during the school day is the 
савест atmosphere in which each pupil feels 
he is an accepted and contributing member o£ 
the group, and in which the relationship between 
teachers and pupil is congenial and productive 
of satisfying experiences Їог both. 

A further conclusion of this exploratory study 
is that in addition to the effect teacher-adminis- 
trator and teacher-pupil relationships have on 
the attitudes of teachers toward the value of cur- 
riculum planning, the teachers' belief inthe 
need for continuous curriculum change is close- 
ly related to a “вепве of belonging" in the Ше 
of the community. Teachers who felt strongly 
that they contributed to the civic Же of their 
community were likely to be favorable in their 
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attitudes. 
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Community status related significant- 


ly to favorableness toward curriculum c ha ng e. 
Such a relationship indicates the importance of 


tea 
ity 


tea 


chers participating responsibly in commun- 
life and needs of its people. 

In summary, this study of the factors in the 
ching situation that related т а positive way 


to attitudes toward curriculum change reveals 


tha 


t teachers are more favorable if they feel 


that they are making a contribution to the school 
organization as a whole and that they have hada 
meaningful share in policy decisions and their 
implementations; if their relationship with pupils 
in the classroom is a harmonious one; and if 
they are active participants in the life of thecom- 
munity. The findings indicate that these four 
factors affect the attitudes of teachers more than 
the factors of teaching-load, subject or grade 
taught, or any of the mechanical conditions of 


wo 


rk. 
The findings of this Study further substanti- 


ate the central hypothesis that the degree of fav- 
orableness of teacher attitudes toward curricu- 
lum change relates Significantly to the factors 
within the teaching situation, most specifically 
to' the interaction of teacher and administrators, 
and of teachers and pupils in classroom activi- 


ties, 


Whether this interaction determines the 


attitude or is instead determined by a factor yet 


unmeasured awaits further study and experiment- 
ation, 


» Association for 8 


. Bain, Read, 
. Bain, Winifred Е. 


. Barr, Arvil S. 


. Barr, Arvil 5., and others, 


» Barron, Caroline KS 5% 
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December, 


- How do you feel that the pupils in your school g 


» In general, how do you handle pupils when they want t 


- How much value do you find in planning with your 


+ What contact do you have with the pupils in the commun 


» During the school year how much time do 


- How well do you feel that teachers work t 


+ Do you feel that teachers have a real part in determining t 


* How well do the administrators understand and гесов 


+ Have you been encouraged by your admi 


» How frequently have you been consulted about curriculum 


-р 

9 you have any fairly close friends 
* Аге there some teachers in the school with whom у 
* Whose opinion on school matters would 


» How do you feel about this curriculum study as com 


* What help do you look for in actual classroom 
* Do family or home responsibilities mà 
` How tree do you feel to make suggestions for curri 
` К you һай your choice, what size group 


` What suggestions do you have f 
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APPENDIX 


INTERVIEW FORM WITH CATEGORIES FOR CODING 
INTERVIEW DATA 


et along together? 


- How often are you able to help pupils with personal problems ? 


o do something you feel is dis- 


turbing to the group? 
pupils for class activities ? 


» How well do pupils understand and accept what you are trying to do for them ? 


ity? 
you spend outside school with your teacher 


fri 
riends? How much with other friends? 
ogether in your school? 


he policies of the curric- 


ulum 2 
nize your teaching situation? 


nistrator in dealing with а school problem ? 


plans? 


* To what extent are you active in community life? 


in the community ? 
ou regularly associate? 


mean the most to you? 


pared to other work for class 


Preparation you might be doing? 
teaching aS а result of this study ? 


ke а difference in your share in the study? 
culum change? 


would you like to work with? 


ог curriculum revision as you see the needs? 
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DIETARY PATTERNS ОҒ NEGROES. IN THE 


COMMUNITY OF SCOTLANDVILLE, . 
LOUISIANA’ 


р. Е. THRIFT and В. В. WARD ** 
Southern University 
Baton Rouge, Louisiana 


PART I Factors included in this study which affected 
their meal pattern were income, education, re- 
ligion, custom, and food dislikes. Therefore, 
these questions were included in the question- 
naire. The persons interviewed were also ask- 


THE 
determine the POSE of this study was to 
© food habits of Negroes in Louisi- 


Such ed = felt that there was a real need for 
Vàilable а 3 Since no such information was а- ed to name the foods they usually ate for a week- 
informatio, the findings should provide basic day breakfast, lunch, and dinner. In instances 
outa for teaching material for the 1004 where the menu differed on Sundays for break- 
Sity as w lon classes taught in Southern Univer- fast, lunch, and dinner, the foods were listed. 
н ell аз other агеаз. They were also asked what special foods they 
Other questions asked were 


туе hu Ён 
Munity о ndred families, residents of the com- 


for stug Scotlandville, Louisiana, were chosen 


ate on holidays. 
the following: 


Ons: firer This choice was 5 
: fir made for two reas қ Қ 
lation 286 есанве 95 percent of the total popu- 1. What is the weekly and/or monthly in- 
Proximit 6 ка. and second, because of the come? d d for food К 
А СЭТГЭХ а ин io Southern Univer- 2. HOP Ari Lic M и 
у e, the si iver- n { 
› а Stat site of Southern Univer 3. How often is each food eaten daily and/or 


3 Рорщацо €-Supported school Гог Negroes, has eekly? 
w 


issippi pio? Of 3593 i ен 
the c iver six 22. 4. How are these foods prepared? 
indust эл Of Louisiana. There аге many large 5. How often do you serve meatless dinner? 
Provide al plants Situated along the river which 6. What meat substitutes do you use? 
, The qi апу sources of employment. 7. What foods do you шешке 
ing the тс АТУ pattern data ons collected dur- 8. What foods do you eat between meals? 
of 1949 month of June September. and October 9. How many meals are eaten daily? 
1950, дал June, Бог a га 10. Which is the heaviest meal? 
Nto о poi Э 3 : 
The Consideration веш OF ume were Шак а 7 The material from this dietary study was tab- 
Was a hod used for 5 2. pi csi lated by placing foods into their major groups. 

n 2@зопа] interview ng ще ШӘР Meats included fish and poultry. Vegetables 
the me der to get ап accu mm were divided into four categories: cooked green 
Views ers of the Ра таза record о: іі; еі vegetables, other cooked vegetables, raw and 
Consy ere ћеја with а Таре ained canned vegetables, and legumes (beans, redand 
the monet Who filled out th ami А уа е oai white). Fruits were fresh, canned, and dried. 
Serye her or à шон : ques ди bent Dairy products were milk (fresh, canned, and 
Cent = in the capacity s of the akg - dried), butter, and cheese. Cereal products 
by the “ав families 1 мо зонд were bread (white, whole wheat, and corn), рге- 

Titers. in this study were com pared and unprepared; rice, macaroni, spaghet- 
* 
Ты; 
са рег on the health status of fifty families 


in t Study of di è anot] 
he „dietary patterns is being төлемей ШУ ody Red 


ty. The individuals for the 
ей in the meal pattern study» 


re chosen from the five hundred families 


th Participat 

е 

"In от, ing; Dr. Elton Harrison, chairman of the 

Шу S ас Р T following: Dr. n ison, c сөзін 

Eva wiversity пондедве with appreciation ME ee, lov mis efforts in making this study possible; Mrs. 

in 1915 Brown РЧ, Tae Grants-in-Ai udents enrolled in the Division of Home Economics 

Other? for ы а қо the ju ollecting the d 500 families for Part I; Mrs. Dorothy 
ђе i ance 

апд ice; D Associate Professor of Home 


T. V. R. Harrison, Professor 9 
and Nurse 
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ti, and hominy grits. The beverages included 
coffee, tea, and cocoa. Other foods listed were 
commercial puddings, desserts, molasses, jams, 
jellies and preserves, which are rich sources 
ofsugar. Eggs and bacon were listed Separate- 
ly. 


Summary of the Data 


Of the five hundred families included in this 
Study, the average size of the family was 4.5 
persons. The largest family was fourteen in 
number and the smallest two. 


Income 


The average per annum income for the five 
hundred families was $1941.44. The range was 
Írom $280 to $9000 рег year. Of the five hun- 
dred families in the community of Scotlandville, 
one percent was earning less than five hundred 
dollars; 12 percent of the families were earning 
between five hundred and one thousand dollars 
per annum; 14 percent were receiving between 
one thousand and fifteen hundred per annum; 21 
percent were receiving between fifteen hundred 
and two thousand dollars per annum; 20 percent 
Were receiving between two thousand and twenty- 
five hundred; 5 percent were receiving between 
twenty-five hundred and three thousand; 4 per- 
cent were receiving between three thousand and 
thirty-five hundred; 3 percent were receiving be- 
tween thirty-five hundred and four thousand; 1 
percent were receiving between four thousand 
and forty-five hundred; 2 percent were receiving 
between forty-five hundred and five thousand; 1 
percent were receiving five thousand and over; 
14 percent were unemployed, A report was not 
obtained from 7 percent of the families. (See 
Table 1.) 

It was noted that the famil 
about 42 percent of the wives 
the home, was less than one 


ies’ income, with 


Education 


Eleven percent of the wi 
the husbands had Wives and 7 percent of 


s Five 
percent of the wives and 2 pe 
bands had completed college, се kisa 
Religion 

Out of the 500 families studi, i 
faith dominated хог both husbands (66 pi 


(Vol. 23 


and wives (77 percent). Methodism ranked SEG 
ond for husbands (10 percent), wives (11 m 
cent). Roman Catholic membership. uc o cio 
third for husbands (2 percent) and wives ( Б. 
cent). Other faiths were represented in ог = 
listed: Presbyterian, Holiness, Lutheran, 
gregational, and Jehovah Witnesses. 


Occupation 


The chief occupations reported were Де, 
lowing: unskilled laborers, 51 e та 
and 6 percent wives; skilled laborers, г 
cent for husbands and 1 percent for yiyesi Бин 
fessional workers, 6 percent for husban cent for 
12 percent for wives; unclassified, 1 те ime 
husbands; 12 percent of the husbands we ware 
employed. Only 19 percent of the wives 
employed outside of the home. 


Place of Birth 


0 
Sixty-four percent of the husbands ра 
percent of Ше wives were born in Louisi 1, Тех” 
Other states represented were Mississippi, i 
аз, Ohio, Alabama, Georgia, Arkansas, 
Carolina, South Carolina, and Wisconsin. 


Typical Meals 


Breakfast 
: ак“ 

The following is a menu of a typical E = 
fast eaten by five hundred families: он percent 
on, grits, bread, and coffee. Thirte nk milk 
ate fruit in some form; 32 percent dra r^ 
аз a beverage; 2 percent drank ^ 
cent ate cereals other than grits. ( 
I. 


Lunch 


h; 
r lunc = 
Twenty-one percent ate left-overs I knick 
22 percent ate sandwiches; 22 perce e Tab 


knacks; 34 percent did not eat lunch. 


IH.) 
Dinner Р 
dinne 
The following is a typical ше starch 
menu: lean meat, rice, one green 
vegetable, and corn bread. 
ern 


tt 
Factors that Influenced the Meal Ра 


Income ат? 
шэнжэ а. 
ше t 
The average per annum income tor nt spe? 
lies was $1941.44. The average à 
for food was $752. 97. : amount ч 
There are wide variations in the 


TABLE 


T 


INCOME OF 500 FAMILIES 


Range of Income Number Percent 
$ 0-$ 500 5 1% 
$ 500 - $1000 62 12% 
$1000 - $1500 68 14% 
$1500 - $2000 106 21% 
$2000 - $2500 100 20% 
$2500 - $3000 27 5% 
$3000 - $3500 21 40, 
$3500 - $4000 17 3% 
$4000 - $4500 2 1% 
$4500 - $5000 9 2% 
$5000 - and above 15 3% 
Number unemployed 68 14% 
ТАВЬЕ Ш 


FREQUENCY ОҒ FOODS CHOSEN FOR LUNCH BY THE WIVES 
AND CHILDREN UNDER SCHOOL AGE* 


TABLE II 


FREQUENCY OF FOODS EATEN FOR BREAKFAST 


Foods Number Percent 
Bread 426 85% 
Grits 395 79% 
Eggs 333 67% 
Васоп 256 51% 
Coffee 206 41% 
Вийег 205 41% 
Milk 160 32% 
Сегеа15 72 14% 
Fruit 63 13% 
Juice 35 7% 
Syrup, preserves, etc. 11 JA 
Cocoa 8 2% 


Foods Number Percent 
Sandwiches 110 22% 
Left-overs 109 22% 
Cold drinks 33 1% 
Fruit 16 3% 
Milk 15 3% 
Eggs 13 2% 
Вгеаа 9 1% 
Тат 6 1% 
Crackers 5 1% 
СоНее 4 196 
Juices 4 1% 
Cereals 4 1% 
Salad 2 1% 
Butter 2 1% 


*Ninety-five percent of the husbands and the children of school 


age ate their lunches outside of Ше home. 


(ғ<6т “төйшээад 
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money spent for food for families of the same 
size, with'attendant differences in expenditures 
for particular foods. These differences are min- 
imized and tend to disappear with marked down- 
ward shifts in food costs, just as they are ac- 
centuated with marked upward trends in cost of 
certain foods. In families where the income is 
92500 or more, as much as three to four 401- 
lars is spent for fruit. Fruits out of seasonare 
served for breakfast and often for the midday 
meal. Expensive meats such as roasts and 
steaks are on the daily dinner menu. With the 
small food budget for the very low income level, 
the choice is limited; red beans cooked with sal: 
pork and served with rice constitute the substan- 
tial part of the meal. 

А large number of the families, eighty-eight 
percent, plan their meals by the day; 6 percent 
plan their meals by the week; 6 percent did not 
plan meals at all. Sixty-seven percent Shopped 
daily; 6 percent Shopped three times per w век: 
8 percent twice рег week; 19 percent shopped 
once per week. Inadequate refrigeration is one 
factor that was responsible for frequent shopping. 
These families shop every day during the week, 
including Sunday. However, Saturday is the most 
popular day. Eighty percent of them market in 
the morning; 20 percent marketed inthe evening; | 
74 percent market at the corner grocery store; 
10 percent marketed at the chain store; and 15 
percent marketed at the chain and corner stores. 
The location and method of transportation ma y 
prevent a large percent from marketing at the 
chain stores, 

Very little variety was used in the diet. The 
Study revealed that а majority of the families 
had not seen nor heard of such foods as cauli- | 
flower, broccoli, eggplant, and brussel sprouts. 


Those foods that меге known were usually pre- 
pared the same way. 


Education 


| ег, in this Study re- 
г no important bearing on these 


families' dietary habits Ог practices 


Custom 


The type of meal itself, 
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as 
acteristic dishes included, 15 den 
y de- 
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termined оу family сизюп.. On Sunday, Dom 
and eggs are included in the breakfast m А. ны 
Other Sunday dishes are green peas, рога ын 
ad, and chicken. In 85 percent of the hom zw 
corn bread is served with the dinner meal а 
grits arc served daily for breakíast. 


Food Dislikes 


Likes and dislikes often exert undue шон” 
ence, and папу people make personal In 
dislikes the basis of the inclusion or exc Tae 
of a food in their diet. The failure to 7n pass 
cereals, especially whole grain cereals, ts, а5- 
bread, cheese, milk, tea, lettuce, Son Шз 
рагавиз, broccoli, and eggplant reveale 
fact. (See Table IV. ) 


Conclusion 


ies 
The data collected from the wid eee Е 
showed thattheyate the following p со ее: 
fast: eggs, bacon, grits, bread, Ы: in алу 
Only а very small percentage ate fr 5 Ыы 
form for breakfast. Fourteen percent 
ilies ate cereals other than grits. 
percent ate hominy grits, not as Ga | 
cereal, but as а part of the main ids d 
flakes ranked highest in preference ntir 
grain cereals were excluded almost we meaty 
The beverages included in the breaktas milk, 
in the order of frequency were coffee. ne^ 
cocoa. The study also revealed that Pag. 
of the families did not include à d ar to the 
The Sunday breakfast was very pai t 
weekday meal pattern, with the excep 
ham and toast were also served. "T 
A definite luncheon pattern as 
among the families; however, fami p k "m 
lunches ate left-overs, sandwiches, % ands wen 
knacks. The fact that 95% of the ders ke 
employed away from home and carr p 
lunches or ate on their jobs seemed к 
factor responsible for this. an m 
The ones menu always included apt of 
fish, or fowl. The lean meats used A jamb: 
their preference were pork, beef, а nvariabl?. 
Ninety-eight percent of the а рей боп 
used rice, served as a vegetable. served; d 
ànd sweet potatoes were frequently yere serv in 
in the same meal. White potatoes оё were 
but less frequently when sweet р for di” ç. 
Season. The green vegetables изе! ға green 
Were turnips, mustards, or colla ith 
These vegetables were always cooke tha” 
pork. ate 
The Sunday dinner was more ed na 
the weekday dinner. A typical Sun Хо Qu. 
consisted of chicken, green peas, Г’ па des 
salad without the lettuce, hot bread. 
зегі. Canned peaches and, ог pudding 
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TABLE IV 


FOOD DISLIKES 


Number Percent 
Foods 
Meats: 
221 45% 
Мийоп қ 219 44% 
Lamb (roasts, chops, steaks) dr Te 
Veal (roasts, chops, steaks) 24 5% 
Hamburger 27 19 % 
Pork (roasts, chops, steaks, ribs) 15 3% 
Liver 14 = 
Ham : 10 + 
Beef (roasts, chops, steaks) 5 Ч: 
Sausage 3 з 
Васоп 2 % 
Сһіскеп 
Seafoods: х рак 
9% 
Oysters 43 e 
Crab 37 18 
Shrimp 5 7 
Fish 
Beverages: 6% 
M 4, 
Теа 19 ae 
Coffee 19 Ei 
Chocolate rt 1% 
Сосоа 1 
Milk 
Vegetables: 693. 
Mea 68% 
Broccoli 342 61% 
Cauliflower 333 549, 
Asparagus 252 385 
Eggplant 188 16% 
Carrots 82 13% 
Веев 66 12%. 
Сеїегу ЕЭ 4% 
Cabbage р 3%. 
String beans 18 3% 
White beans i 2% 
Окга 2% 
Масагош т 2%. 
Sweet potatoes Š 2% 
Lettuce 


Grits 
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TABLE IV (Continued) 


Foods Number Percent 
Spaghetti 9 2% 
Согп 9 2% 
Onions 7 1% 
Вїсе 1 1% 
White potatoes 5 1% 
Eggs 12 2% 
Сһееве 9 2% 

Cereal and Cereal Products: 

Petti Johns 214 43% 
АП Вгап 212 42% 
Wheatina 203 41% 
Еагша 160 3200 
Cream of Wheat 154 3195 
Kix 138 28% 
Grape Nut Flakes 111 22% 
Wheaties 108 22% 
Oat Meal 83 11% 
Corn Flakes 38: 8% 
Other cereals 30 6% 
Brown Bread 150 30% 
TABLE V 


THE AVERAGE AMOUNT OF MONEY SPENT FOR FOOD PER 


SSS U U U 


Income per Year 


$ 0-$ 500 
$ 500 - $1000 
$1000 - $1500 
$1500 - $2000 
$2000 - $2500 
$2500 - $3000 
$3000 - $3500 
$3500 - $4000 
$4000 - $4500 
$4500 - $5000 
$5000 апа Above 


Регсепї 
of Families 


YEAR ACCORDING TO INCOME 


Ave. Amount 
Spent for Food 


per Year 

1% $ 402.80 
12% 544. 22 
14% 671.32 
21% 115.96 
20% 940. 46 
5% 986. 66 
4% 970. 49 
3% 732. 70 
190 1200. 00 
2% 1074. 66 
3% 1062.20 


Percent Spent 
for Food 


86% 
54% 
45% 
39% 
38% 
33% 
28% 
18% 
27% 
21% 
21% 
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to на, favorite dessert. 
mea] 22 revealed that Ше characteristic 
the three ше the families studied relative to 
light lunch ily meals was a heavy breakfast, 2 
Food dil and a heavy dinner. 

essential 2 ез caused Ше exclusion of many 
Was телі |0048 from the family diet. This fact 
Include се by the failure of many families to 
lettuce с 9215, brown bread, cheese, milk, 

» Carrots, asparagus, broccoli, and egg- 
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plant. 
In one percent of the families it was revealed 


that after taking care of the food budget only 14% 
of the total income was left for clothing, shelter, 
and other essentials. Families with an income 
of $2000 to $2500 per year spent less than 50% 
of the total income for food. In families withan 
income of $3000 to $5000 and above per year 
only 5 percent spent as much as 3075 for food. 


(See Table V.) 


А STUDY OF THE RELAT 
IONSHIP BETWEE 
THE DIETS AND THE HEALTH OF 25 i 
NEGRO FAMILIES IN SCOTLAND- 
VILLE, LOUISIANA 


P. E. THRIFT апа В. B. WARD 
Southern University 
Baton Rouge, Louisiana 


PART II 


P 
ur OSe of Stud 


ORIG 
Si IN 
шау уу ALLY, the purpose of this 


Taza 5, 228 LO i 

AMilies in и the health status of fifty 

ч community Community of fifty families in 

Б» Š to be c e Scotlandville, Louisiana. This 

phase mone eee by evaluating the diets 
БАГ examination by subjecting them to a 

рағы 0146 Were made 

but icipated зу to study 50 families who 

та aiy foretity- fies I of the dietary pattern study, 
Operate | ive families ultimately agreed 

in this investigation. а 


Pr 
“cedure 


The р 
тшу 16 data wer 
бин 5 етиши during Ше month of 
баты] ate, a er to ascertain what the 25 
ully kept шше dietary record was 
Тещ 21 one At head of each family for а 
ету l'écord by c Each family filled out the 
name У гесога sk Checking the form daily. The 
Qua; Sach ње р Гог each day included the 
2 the ER, а list of foods eaten, th^ 
Videg о “Sten eters and in addition, the kindand 
Оп the кес ween meals. Space was pro- 
€d qai; ТО ins ога sheet for additional foods if 
Чин, Де With tha ce аесогясў, сопвоатив check 
loq есогаҳ ле families on the filling out of 
ец, ary ee: the end of the seven day per^ 
The <сереа хэв were collected and evalu- 
1 fifty ra Standards were followed. * 
tion а СТУ ия were subjected toa medi- 
Wen “унь included a physical examina- 
Competent physician. 


meo et Only w 


| Chae caloris the percentage of the group 
MTM 1, but ог too low ав shown 
p СК or Ч nutri he group fell far short on other 

ое, balines тас The study also revealed а 
“Don 5 in eve between carbohydrates, fats and 

Зуу от ryfamily studied. Fats жеге used 
i с "над е М. "Food Compo; 


excessively in 100% ofthe cases. This can be 
accounted for by the fact that the method most 
ly used for preparing meats was frying 


frequent 
tables used were cooked with 


and that all vege 


fat pork. 
The dietaries studied showed generally that 


the amount of vitamin A consumed by these fan- 
ilies came chiefly from turnip or mustard greens, 
sweet potatoes, and cushaw. Ascorbic acid 
was derived from cabbage, grapefruit, orange 
juice, and raw tomatoes. Thiamin, riboflavin, 
апа niacin came from lean meats including chick- 
en and liver; enriched breads. 

Although 20% of the families were not receiv- 
ing adequate amounts of proteins, the proteins 
consumed were complete. They came chiefly 
from lean meats, fish, and poultry. Dried peas 
and beans were included almost daily in the di- 
ets of 64% of the families. 

As seen in Chart 1, 60% of the families were 
consuming less than the recommended amounts 
of calcium. This was evident from the sm all 
amount of milk used in the diet. Families re- 

unts of calcium obtained it 


ceiving adequate amo 
ed milk, mustard and/or 


mostly from evaporat 
Milk, green peas, sweet corn, 


turnip greens. 

eggs. and canned fish helped supply sufficient 

amounts of phosphorus for 60% of the fa m ilies. 
of leafy greens, enriched breads, 


The variety 
and liver provided the chief sources of iron for 


80% of the families. 
When а family’s food consumption record in- 


dicates that it met the recommendations in nine 
or more of the nutrients as shown in Chart 2, it 
was rated good. It was rated fair if it met from 


five to eight of the nutrients; poor if it met the 
recommendations 1n less than five nutrients. 


Summary 


sixty-eight percent of the families were con- 
suming less calories than recommended and 
64% ate less carbohydrates than was necessar 
The study also revealed that their meals la с i 


ed proper balance. 
Twenty percent of the families were not re- 


sition Table for Short Methods қ 
Association, XXI (July-August i gel Хи 


веру. 2 204 Leichsenring фат! д 3 
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CHART 1 


PERCENT OF FAMILIES MEETING INTAKE 
RECOMMENDATIONS 


Carbohydrates 
Phosphorus 
Vitamin A 
Ascorbic Acid 
Thiamin 
Riboflavin 


| 


Calories 


EN Proteins 
| 


СНАЕТ 2 


EVALUATION OF DIETARIES 


Good Fair 


4% 44% 


Роог 
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Ceiving 
those suena amounts of proteins. However, 
ey came ЯМ were complete proteins since 
poultry. р мегу from lean meats, fish, and 
almost жиг beans and peas were included 
ixty 4% Y in the diets of 64% of the families. 
1655 над сул, of the families were consuming 
This was e е recommended amounts of calcium. 
9f milk “5 эр) because of the small amounts 
the recomme Forty percent were not receiving 
iron 2 mended amounts of phosphorus. In 
intake. о Were not reaching the recommended 
Fort 
Tecomme ascent were receiving less than the 
receiving RA amounts of vitamin A; 44% were 
of 8Scorbic Ss than the recommended amounts 
than the таван (vitamin С); 32% receiving less 
min В во mended amounts of thiamin (vita- 
о receiving less than Ше recommend- 


ed amo ; 
uni : 
ts of riboflavin (vitamin В»); and 28% 
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were receiving less than the recommended а- 
mounts of niacin. The chief source was enrich- 
ed bread; in some instances 4 to 6 slices were 
consumed ata single meal. Other sources were 
leafy greens and lean meats. 

It was interesting to note that no family ех- 
cluded breakfast. Only two meals were served 
on Sundays; this included a heavy breakfast anc 
heavy dinner, lunch being omitted. 

The physical examination for the twenty-five 
persons studied showed the following results: 
20% were underweight, 52% were overweight, 
and 52% had dental caries. 

There was only one case of diabetes. The 
other subjects studied had no specific diseases. 
Ninety percent, however, did have ailments now 
known definitely to have dietary origin, these be- 
ing fatigue, frequent headaches, and constipa- 


tion. 


REVERSALS, REVERSALS, REVERSALS! 


HELEN KENNEDY 
Los Angeles State College 


, OVE 
Heuiarly qu PERIOD of many years, par- 
пе educational ai last twenty or twenty-five, 
о мајпед reed ia пене ле literature has 
m isted Symb S on strephosymbol- 
Псе has be ols. During this time little ad- 
Condition. ia made in the understanding of the 
22 15 due Зарна well be that the lack of advance- 
11806 to differ he fact that little effort has been 
о ascertain тана Ше types of reversals апа 
Е а grou requency of their occurrence 
vels, Sahaa normal children of given age 
tho Were core was made in 1934 but the 
ed ЧЕ these dat; reported in the literature. А1- 
à at this ос ta аге old they are being present- 
8 research xd the hope that persons continu- 
е first ste his area may find them useful. 
isea € of such a study was, of course, 
frequ al types бен ei with which various 
with епсу of the; uld be differentiated and the 
Ons Children of ir occurrence could be studied 
58 Of the M different age levels. In Part 
pt following th twelve exercises were present- 
left се the ke ree practice exercises. In each 
ling Оп, Та PIE was presented as the 
Өхсєрү еге twelve he right, separated by a double 
5а that only t Symbols like the key symbol 
i СУ three of the twelve were in the 
three Were inverieg (7S Other nine symbols, 
bols Were зоосыг three were reversed, and 
Wed аз КЕ €d-reversed, Thetwelvesym- 
Were bers sup included five letters, 
Неща, ВЭ, eus S designs. The five letters 
Son ae letters ye 1”, «47 and “t”. These par- 
letters e Confusing Selected for the obvious геа- 
lentaga’ Both « “Ons which occur with other 
Ang Опа] variati and “4” are almost exact ог” 
“елы “f -—— each other and of 90” 
id moral son. ' are similar except for 
na, he «ys, nd ions and are also similar to 
SS ny аге c n" are inverted-reversed 


to de 


9» vege aaa 
Erteg T ма, and “6”, The other stimu 
^y $ ''5" which is very like “2” when 


d | r 
ght in 
the оға length 


‚АП dp 
Major r Televant pattern and one each of 
eversal types 


The irrelevant stimulus pattern which was 
included in each of the exercises in Parts Two 
and Three was a word pattern of the same gen- 
eral configuration but which did not contain any 
of the same elements. It was assumed that if 
no discrimination was taking place this pattern 
would receive a comparable share of responses. 
The first type of reversal was calleda letter 
change since the disorientation involved only one 
letter in the word. The change was either а ге- 
versal, an inversion, ог an inverted-reversal, 
Examples of these changes are, respectively, 
*tpig-dig", “pig-pig”’ and *dig-pig". Thestim- 

lected so that the letter with 


ulus words were se 
which the change occurred might be in the init- 


ial, the internal or the terminal position in the 
word. The second type Was called the reversed 
form. In this situation each letter remained 
correctly oriented but the sequence of the let- 
ters was reversed, i. e., ‘cwas-saw’’. The third 
type was called the mirrored image. Here 
again the orientational change occurred either 
by inversion, reversal or inverted-reversal. 
These effects may be obtained by the use of mir- 
To observe the inverted mirrored image 


rors. 

the mirror should be placed above or below the 

symbol. The reversed mirrored image may be 
mirror either to the right, 


seen by placing the 
the left or parallel to the symbol. The simplest 


means of seeing the inverted-reversed form is 

to turn the page upside down. The last major 

reversal type was termed transposition. Eight 
tions were identified and in- 


types of transposi 
cluded in the final form of the test. The trans- 


position types identified were as follows: 1) іп- 
itial letter to an internal position; 2) initial let- 
ter to terminal position; 3) terminal letter to in- 
itial position; 4) terminal letter to internal ро- 
sition; 5) internal letter toa different internal 
osition; 6) internal letter to initial position; 
7) internal letter to terminal position; and 8) 
miscellaneous changes involving several of the 
others or more than one letter. In Ше data to 
be reported in this paper the types described 
above аз 6, 1, and 8 were all included under 
miscellaneous. 
with two letter words it is, of course, im- 
possible to have a transpositionother thana re- 
versed form. Therefore, in the first six exer- 
cises of Part Two, there are two mirrored 
forms rather than two reversed forms of the 


word. 
part Three of the test is based on the same 


TABLEI 


TOTAL NUMBER OF TEST PAPERS AVAILABLE FOR USE AFTER MAKING 
EXCLUSIONS BECAUSE OF UNSUITABILITY FOR COMPUTA TION OF 
AVERAGES, BY GRADE LEVELS 


Total No. i 
Bt pests Test Papers Retained 
Administered Part I Part II Part IH 
Grade Level Form Form Form Form Form Form Form Form 
1 2 1 2 1 2 1 2 
LK (Low Kindergarten) 29 45 26 38 16 26 * * 
HK (High Kindergarten) 45 43 36 36 25 28 * * 
L1 (Low First) 36 37 35 35 32 31 * * 
H1 (High First) 64 69 63 67 57 67 24 32 
L2 (Low Second) 38 48 38 48 38 48 22 26 
H2 (High Second) 48 96 48 96 48 96 39 78 
260 338 246 320 216 296 85 136 


*Note: Only a short form of the test, i.e., parts I and II, were given to Ше lowest grade levels, 
as part III requires more word knowledge than is expected of children in those grades. 


91 
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TABLE II 


PERCENTAGE OF TOTAL POSSIBLE RESPONSES IN EACH CATEGORY WHICH IS FOUND WITH 
THE AVERAGE OF EACH CLASS RESPONSE TO THAT CATEGORY, IN PART ONE 


Correct Incorrect Inverted Reversed Inverted-Reversed 
Responses Responses Responses Responses Responses 
Form Form Form Form Form Form Form Form Form Form 
1 2 1 2 1 2 1 2 1 2 
LK 63.8 65.8 22.1 15.2 20.2 12.6 31.4 28.4 13.8 5.8 
HK 64.0 61.4 20.2 20.0 17.0 13.2 35.6 38.8 8.2 8.4 
Li 83.4 17.6 12.8 8.9 10.5 10.9 23.0 13.3 4.8 2.9 
Hi 19.2 80.4 10.5 8.2 9.7 9.1 16.6 13.2 5.3 2.5 
12 88.7 91.8 2.8 5.1 4.7 9.3 3.5 5.9 15- 21 
на 95.0 90.2 3.07 6.4 5.7 10. 9- 3.3 7.0 .29 1.5= 


(8661 “təqtuəoəq 


AGSNNODI 


891 
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TABLE III 


PERCENTAGE OF TOTAL POSSIBLE RESPONSES IN EACH CATEGORY WHICH 
IS FOUND WITH THE AVERAGE OF EACH CLASS RESPONSES 


TO THAT CATEGORY 


Correct Incorrect Irrelevant 
Responses Responses Responses 
Form Form Form Form Form Form 
1 2 1 2 1 2 
22225015 = 95 4 _ ~ Елате 
PART TWO 
LK 38.4 40.3 20.2 21.1 1.8 2.1 
HK 42.0 50.7 16.1 19.4 2.3 1.8 
11 66. 2 75.0 13.3 8.8 .25 .4 
Hi TRS 84.6 8.7 7.4 .22 .2 
12 92.8 89.6 3.4 3.7 00 m 
H2 93.0 92.4 3.4 2.6 00 . 04 
РАВТ ТНВЕЕ 
Hi 24.1 26.6 15.0 14.4 7.2 7.8 
L2 38.7 32.3 9.5 9.8- 6.1 4.8 
H2 56.0 53.8 7.3 9.3- . 86 2.4 


Omissions 
Form Form 
1 2 


3.1 


6.1 
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master 
воа аи и Two. It contains Нуе more 
In length fro n does Part Two and the words vary 
ulus pattern ir three to nine letters. The stim- 
Child is re n in Part Three is a picture and the 
Tesents НЕЙ to select the word which гер- 
ег from к All words for the test are 
0 forn ates Primary Word List. 
the same bend the test were developed from 
Were used im er plan. Some of the same words 
сы to Check ын two forms which made it possi- 
bus exercise he effect of position of the word in 
Урев of err ала its relative position to other 
Of th Ors. Naturally the administration 


€ test 
forms, Was also facilitated by having the two 


It will 
the stuq ме recalled that one of the purposes of 

OCcurrence О determine {һе relative frequency 
роп childre of the various types of reversals 
t рове, йана. of given school ages. For this 
dr, Kinderpartes ол was obtained to test all of 
ai" і БЕ ai first and second grade сһ11- 
авара ers which he Pasadena City Schools. Not 
is le. Tt wag Were obtained were found to be 
othe S in one Possible, however, to use Шеге- 
рет, Part of Яо of the test even though an- 

Š Were € test had to be disregarded. Pa- 


half Consi 
Of the с sidered as acceptable if at least 


eq exerci 

respo o mika te of a part had been attempt- 

Чеш: ees Were лг соль oe Ше irrelevant 
marked and if there was по evi- 


to a 

рова: 4 Patterni 

зушы Шол оп main of the responses according 
Sk е paper, i.e., always the first 


not After qi 

Stugy “Ct the ар сага all papers which did 

the р? in со е criteria, there remained for 
mp , 


о уме = m group averages, { 
г pers for the three partso 
of ее sorted in Table I. pa 
Чалы Significa n Ses made by the childrenare 
“Мануе па шее unless the qualitative and 
ње NU › it ге of the errors may be determ™ 
ка their See necessary to consider the ег- 
Ёс Not SSifications S type classifications and 
"8 the Present ihe Since, however, the tests 
ap ега] t е same opportunities for шак” 
u Ц р. of errors it is desirable to 
re in тар Регсепавев. Such will be the 
Вон П through VI. The base will 
АВ сыен offered for responses 
FS thee is the _ sideration and the reported 
ae е : total a e portion that the responses 
6 p ase. 
h озын an Part One of the test there 
hd the p ЛҮГЭЭ eee Ithe aver- 
ls og by qe бе су t 22.97 correct responses, 
mS, termini 0 respond correctly is meas" 
big тїй: тз 87 the percentage which 22.97 
5с 510. 
|- "epo ой the регеа with the results from 
às e est. In the first two columns 
relationship between the ave" 


c 
Orrect responses, for еас 


пц 
е test be г 


е 
Pumpe 


KENNEDY 165 


form of the test, for each grade group and the 
total number of opportunities for such respons- 
es. The next two columns, in like manner, in- 
dicate that percentage which the average num- 
ber of incorrect responses is of the total num- 
ber of incorrect responses which it is possible 
for one to make. The remaining columns con- 
cern the subdivisions of the incorrect respons- 
es. The data in them were calculated in the 
same manner as in the first Íour columns. 

In Part One of the test there have not been 
d any possibilities for an irrelevant re- 
sponse. Furthermore, in the scoring of these 
exercises no consideration was made of a fail- 
ure to mark all or part of an exercise, as Part 
One of the test was scored exclusively for re- 
sponses actually made. Consideration of irrel- 
evant responses and omissions, however, is 
given in scoring Parts Two and Three. 

Table Ш indicates the tendency at eachgrade 
level to make correct, incorrect or irrelevant 
responses or to omit making any response with 
parts Two and Three of both forms of the test. 
The data reported in this table were derived by 
а method similar to that described for the deri- 
vation of the data in Table П. Sub-classifica- 
tions of the incorrect responses will be present- 


ed in Tables IV, V and VI. 

In Table IV i$ presented the percentage of 
frequency of occurrence, in relation to the op- 
portunities for each, of the four major reversal 
Tables V and VI present the breakdown 
he subclass ification prev- 


include 


iously identified. 
‘Although it is recogi 
subjects involved in thi 


to permit the forming ofan | 
багийн indications are more thansuggestive and 


worthy of further exploration. Two questions 
seem pertinent with regard to the maturation 
process which ultimately results in the almost 
complete disappearance of the reversal tend- 
ency in the work of the average or superior child. 
One of the questions considers whether the Íre- 
quency of occurrence of the reversal situation 
as a whole significantly and steadily decreases 
as the children become physically and education- 
ally more mature. А second question is wheth- 
rticular reversal type deviates signif- 
general pattern of the whole 
tuation. 
tion may be answered emphat- 
Consideration of the 


nized that the number of 
s study was not adequate 
y definite conclusions, 
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cess with this test seems to have had its origin 
us to the child's entrance 
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ct discrimination was not to any great 
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TABLE IV 
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PERCENTAGE OF TOTAL POSSIBLE RESPONSES IN EACH CATEGORY WHICH 


IS FOUND WITH THE AVERAGE OF EACH CLASS RESPONSES 


TO THAT CATEGORY 


Letter Change Reversed Form Mirrored Transposed 
Responses Responses Responses Responses 
Form Form Form Form Form Form Form Form 

1 2 1 2 1 2 1 2 _ 

PART TWO 

30.2 25.5 25. 29.4 13.7 13.9 194 22.0 

29.7 21.4 18.3 23.6 10.6 15.2 14.1 18.8 

25.2 21.2 12.0 6.0 6.4 2.3 9.0 8.2 

24.0 20.3 5. 8 5.9 4.7 3.1 4.8 48 

13.3 12.2 .66 22 (688 — 104 1.4 ын 

10.7 1.6 1.39 2.0 ‚14 9 2.6 udi 
PART THREE 

20.4 17.8 10.5 10.1 8.5 9.5 13.5 13.97 

14.2 16.0 4.4 4.8 5.7 4.4 1.8 14.6 

12.3 17.7 2.2 3.3 1.9 2.5 9.0 p 
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TABLE V 


PERCEN 
TAGE OF TOTAL POSSIBLE RESPONSES IN EACH CATEGORY WHICH 
OF EACH CLASS RESPONSES 


IS FOUND WITH THE AVERAGE 
TO THAT CATEGORY 


Mirrored Forms 


Letter Changes 
Inverte 
— Reversed Inv. -Rev. Inverted Reversed Inv. -Rev. 
Forms Forms Forms 
2 1 2 


[RE Forms Forms 
: ~ 1 2 1 1 2 

"E thy зва PART TWO 
HK эв, t ед за маза 84 11. 23.7 23.4 9.3 8.0 
м arg . 8 вап 47.0 245 207 95 85 17 2 259 67 8.3 
Hl 20.0 Ls sh 95 ma des 10 40 № 26 36 .3 
10 16 tis зай dus dés ве 59 24 ss ща За odd 
& _ #4 Ha 2368 85 лаш 18 1.8 1800204 

15 &5 171 153 13 86 11 g 10 18 4 Ё 
м 17.9 PART THREE 
Ї р 4 16.3 260 207 185 142 79 ag 108 0.6 5i 8.0 
x м 11.1 15.9 22.9 144 12.5 58 ха ва өй 55 30 
- ша 37 28 1.3 2.8 4 20 
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TABLE VI 


PERCENTAGE OF TOTAL POSSIBLE RESPONSES IN EACH CATEGORY WHICH 


IS FOUND WITH THE AVERAGE OF EACH CLASS RESPONSES 


TO THAT CATEGORY 


(Vol. 23 


Initial to Initial to Terminal Terminal Internal to Miscel- 
Internal Terminal to Initial to Internal Internal laneous 
Position Position Position Position Position Position 
Forms Forms Forms Forms Forms Forms, 
1 2 1 2 1 2 1 2 1 1 
PART TWO I 
LK 20.2 30.4 6.2 243 83 17.3 31.3 25.7 37.5 38.5 16.2 8. 
8 
HK 80 19.0 60 119 5.3 19.6 26.6 23.8 28.0 26.8 19.2 12. 
2 
м 6% 6.5 31 4.3 5.2 3.2 17.7 15.0 33.4 19. 56 5 
9 
н 26 6.0 00 00 12 00 14.0 8.0 12.3 12. 3.5 3 
‚5 
12  .7 14 00 T .9 00 44 49 2.6 13. pi 5 
1.6 
H2 .5 2.0 00 00 00 00 4.9 5.0 16.7 11. 2.5 
4 РАНТ ТНВЕЕ 9.4 
7.5 25 13.5 133 5.6 6.2 24.2 34.4 13.9 14. 13:4 
12 8.1 
2.7 16 5.7 8.0 4.5 4.0 13.6 39.2 13.6 24. 1.2 г 
на 1. 4. 
5 L3 63 3.5 00 1.6 16.7 39.6 20.0 28. 9.4 
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There is, surprisingly, a small number of 
errors with the mirrored form of the word. It 
seems that the gross orientation changes are 
more easily recognized than those of the same 
type which involve only a letter of the word. 
Again the reversed form produces a higher de- 
gree of error than the others but rapidly de- 
creases toa comparable level. These data do 
not appear to indicate that the mirrored forms 
of the word constitute any very great potential 
difficulty. There exists, however, a very strik- 
ing similarity in the contour of the curves of the 
corresponding sub-types of the mirrored forms, 
the letter orientation changes and the single sym- 
bol type of Part One. 

There is rather rapid disappearance of the 
tendency to transpose letters where the initial 
letter is concerned. In instances where the 
transposition involves only the internal letters 
or an internal and terminal letter, there isa 
greater tendency for the error type to persist. 

One might conclude from these data that the 
occurrence of reversal errors of all the types 
studied are perfectly normal in the earliest 
grades and that it is equally normal for them 
practically to disappear as the child progresses 


through the first several grades. 

Even though it is granted that some tendency 
to make errors of the types described 18 погш- 
al at given age levels, the question still remains 
as to what can be done when the tendency рег- 
sists. The question might also be raised as to 


whether the tendency needs to exist to the de- 
gree that it does even in the very early grades. 
Many of the conditions studied have been as 
poorly defined and as incompletely considered 
as have the types of reversals, consequently, 
the findings are inadequate and inconsistent. 
perhaps the simplest explanation, and the one 
which is likely responsible for most of the ге- 
versals, seems to have been completely оуег- 
looked, at least as far as reports in the Шега- 
ture are concerned. The idea was brought very 
forcibly to the attention of the writer when a 
school boy asked whether it made 


junior high a 
fference which way the stem and the bulb 


any di : 

pointed. A boy is a boy, regardless of whether 

he is facing north or south, standing on his feet 
d. Soitis with the material things 


or his hea EUM = Á 
with whicha child is familiar. Yet in writ- 


ing, and particularly with printed symbols, we 
take one symbol, turn it in four directions and 
call it by four different names. How often is 
it explained that in the reading of word symbols 
treets are one way, from left to right, 


all the 5 
at least in the languages to which most of us 


are exposed. | 
с Certainly it is not the contention here that so 


simple ап explanation is the answer in all in- 
stances. It is well worth a try and will elimin- 
ate, for fur ther consideration, many young- 
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sters now classified as having ‘‘reversal diffi- ient, then those whose problem is more complex 
culties. " When such children have been re- may be studied with some hope of determining 


moved from consideration by this simple exped- causative or at least relational factors. 
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however, appeared to indicate 
even by inspection, that certain important and ; 
unique differences might exist. This factor was 
what may be termed the image of the instructor 
manifested by the student. That is, there ap- 
peared to be, and the experimenters themselves 
also reported, that there was variation in the 
way that students of different class sections per- 
ceived the instructor. These differences, there- 
fore, were investigated more carefully and the 
results of this analysis furnish the basis for this 


report. 


One datum, 


search 


The Design of the Re 


It is not important that the total research 
plan be reported, since only à segment of it is 
The experimental procedure, 


discussed here. 
d be presented. 


The original sample for the total research 
design consisted of some 184 regularly enrolled 
students in à general education college course 
called Effective Living. 4 These students were 
taking the second term of this three term course. 


Hence, some of them had had previous contact 
However, since these 


with the experimenters. : 
students were randomly located in the experi- 
mental sections rawn, through the 

i a total of 2043 
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sample used in this experiment differed in any 
way significant for the research problem from 
the usual population of freshmenand sophomores 
in earlier or succeeding years. At the time of 
the experiment the veteran population of the col- 
lege was low. 

The research plan called for four different 
kinds of teaching sections and the use of four 
different instructors as experimenters. The 
teaching sections were selected to approximate 
the following kinds: (1) a large lecture-discus- 
sion section of approximately 100 students; (2) 
а medium-size leciure-discussion section of 
approximately 50 students; (3) a small lecture- 
discussion section of approximately 25 students; 
and (4) a small section of 25 students wherein 
the experimenter was allowed complete freedom 
to use whatever methods of instruction he de- 
sired. The first three types of sections were 
designed to control, as adequately as possible, 
the method of instruction. That is, in all these 
sections the experimenter was instructed to use 
the lecture method and allow for such discussion 
as did not prevent his covering the regularly as- 
signed materials, 

It is obvious, of course, that the method of 
instruction could not be held as an absolute con- 
stant. That is, a section of 100 students allows, 
ру the very fact of size, less Opportunity for a 
large number of students to participate through 
discussion or questions. Likewise, the small 
section of 25 students imposes a less formal at- 
mosphere and allows, in terms of simple econ- 
omics, greater participation by more students, 
It should be emphasized here, however, that the 
experimenters attempted to hold constant, inso- 


far as possible, their own presentations. While 
they lectured more in th 
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ficient permiss 
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What is important in this investigation is the de- 
termination of differences between sections and 
instructors regardless of the piling up of scores 
at one end or the other of the scale. The piling 
up of scores, in terms of statistical treatment, 
insofar as it is relatively constant, as in the 
present case, has the practical effect of limit- 
ing the variation and reducing the size of the 
scale. Such an outcome serves to further re- 
duce the probability of obtaining significant dif- 
ferences. Hence, the differences which were 
obtained should be scrutinized with some care. 

It is apparent that in the large and medi- 
um lecture-discussion sections there is consid- 
erable variation among instructors. This vari- 
ation, in the case of the large sections, seems 
to be attributable to Instructor C. In the case 
of the medium sections the difference is appar- 
ently attributable to Instructor B. In the other 
two types of sections the differences are not sig- 
nificant. In the case of the small ‘‘free’’ sec- 
tion there is a trend toward significance which 
is apparently due to a combination of Instructors 
B and C. 

From these data it must be assumed that 
there are differences among instructors 
which are greater than chance and that it would 
be inadvisable to pool the sections by type. It 
might be argued that Instructors AandD 
could be treated simultaneously. However, since 
the size of the sample permitted, it appeared 
best to analyze separately the differences be- 

e sections of each instructor. These 
differences are shown by Table III. 

From this table it may be inferred that for 
this experiment there are significant differences 
not only among instructors butbetween sec- 
tions, when the instructor variable is controlled. 
The differences, however, are not all relatedto 

Thus, for Instructor A, the 


the same factors. 
differences appear to be attributable to his 
more favorable image in the small lecture dis- 


cussion section. For Instructor B tho differ- 
ences appear to be related to his less favorable 
image in the large lecture-discussion section. 
For Instructor C the differences appear to be 
attributed most logically to the less favorable 
image manifested by the medium lecture-discus- 
sion section. While for Instructor D, where the 
differences are not significant, although there is 
a trend toward significance, variation appears 
to be related to Ше more favorable image reflect- 
ed ty the small lecture-discussion section. 
However, certain trends appear to demand 
some consideration. In all cases, the most fav- 
orable image of the instructor is manifested by 
the small lecture discussion section. There is 
also a strong tendency for both the large and 
medium large lecture-discussion sections to 
produce less favorable images of the instructor 
than the small lecture-discussion section. A 


tween th 


TABLEI 


SIZE OF SAMPLE BY INSTRUCTOR AND TYPE OF SECTION 


Large Lecture- 
Discussion Sec. 


Medium Lecture- Small Lecture- Small “Free” 
Discussion Sec. Discussion Sec. Sec. 


Present Present Present Present 
Instructor Enroll- at Final Enroll- at Final Enroll- at Final | Enroll- at Final 
ment Rating ment Rating ment Rating ment Rating 
Instructor A 48 40 24 21 | 25 20 
Instructor B 50 40 25 25 25 21 
Instructor C 4T 40 25 22 26 18 
Instructor D 47 35 23 17 25 17 
Totals 192 155 97 85 101 76 
T- 
Percent in at- 
tendance at 
Final Rating 80. 7% 87. 6% 15. 2% 


РАТ 


комуопаз туамяишняахя JO пУМНПОГ 
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TABLE II 


IMAGE OF THE INSTRUCTOR WHEN TYPE OF SECTION IS HELD CONSTANT 


Instructor 
A B с р 

С1а55 Туре Е Мо. Меап Мо. Меап Мо. Меап 
Large Lecture- 
Discussion Section 4.3* 77 19.6 74 17.3 64 20.0 
Medium Lecture- 
Discussion Section 7.5* 40 19.4 40 20.3 35 21.7 
Small Lecture- 

Discussion Section 1.4 21 15.1 25 16.3 17 17.8 
Small “Free” 

Section 2.0 20 19.5 21 16.8 17 19.5 

*Differences significant beyond 1% level. 

TABLE Ш 


IMAGE OF THE INSTRUCTOR WHEN INSTRUCTOR VARIATION IS CONTROLLED 


Instructor 


Instructor A 
Instructor B 
Instructor C 


Instructor D 


Large Medium Small Small “Егее” 
Section Section Section Section 
Е №. Меап №. Меап Мо Меап Мо. Меап 
3.05 77 19.6 40 19.4 21 15,1 20 19,5 
9. 7% 74 19.8 40 16.3 25 15.5 21 16.1 
5. 6** 82 17.3 40 20.3 22 16.3 18 16.8 
2.1 64 20.0 35 21.1 17 17. 8 17 19.5 


ж Differences significant beyond 5% level. 
**Differences significant beyond 1% level. 
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combination of these trends appears to produce 
Significant differences. 

Still other possibilities are indicated by these 
data. Since both instructor and section differ- 
ences have been demonstrated to be Significant, 
the question arises as to whether still more im- 
portant differences may be due to the interac- 
tion between instructor and Student by type of 
Section. It is possible to obtain a precise test 


erable importance, It would appear clearly that 
i vorably received 


tors usually had à “good” o š 
Hence, it is Suggested from these clues that per- 


іп- 
That is, some in- 
Structors are more favorably received in cer- 
tain kinds of Classes than in others, 


tor may also be crucial for variables other than 
instructor image, 


was not and did not 
се groups, 


formal “free 
Instructor C wa if a А 
Perienced teacher in nything, the most ех- 


n terms 
ture-discussion techni ms of lecture and lec- 


lecture-discussion Section than b 
ction 


me feelings of nad o s Эн 
НУ to ha 


ег Sections. Act- 
lecture-dig, Боно favorably by the small 


Cussi Р 
by his medium-large ӨП апа most unfavorably 

e-discussion i 
Section, 


5. The reader who is i 
i interested i 
Methods (Am 


US, Тома: Тер. State this Statistic 


еве, 1916), р 


3 5 than 
limited in Scope and less rigorous tha 
be desired ines О 4 

1 ;n line ге 
however, because they open certain hom igno" 
vestigation which һауе, in general, 


я u 
to pupil achievement on some fixed талан” t и 
Yet there are few teachers who Жак nieve “| 
critically the hypothesis that pupil а ешге < 
Оп ап objective scale пееевнакПу me енді ' 
Ог even the most important teaching 
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Instructor D indicated that he prc 
Small sections and assumed that he was po 
favorably received by them. It was true EU 
he was most favorably received by the smi хэй 
lecture-discussion section but there 2 эв 
great amount of difference in his recep ae 
the other sections, including the small i 
al “free” section. 


Conclusions and Implications 


ith 
Although it is necessary to possi aca Ei is 
caution the data that have been nei ue. ше 
possible to indicate certain tentative co 
ions: 


7 сїог5 
1. There are differences among v tn ру. 
ав to Ше way that they are rece 
classes of different sizes. 


other 
2. There is a tendency for M TU 
things being equal, to be mee by larger 
received by small sections tha 
Sections of the same typo. 
in the 
: їп 
3. The informal “free” sections eit 
experiment did not produce ie instruc^ 
the most favorable image of mall lec? 
tor. When compared with the mod ifa ely 
ture-discussion sections of E. ee both — 
equivalent size it is apparen must be con 
teaching procedures and size ! 
Sidered, > 
ieve that t 
4. Theré is some reason to pais to the. 
interaction factor may be tee instruct? 
perception by the student of t 9” 
ts Ше ~. 
5. Finally, this experiment аа, able con 
pothesis that instructors are ception uy 
Sistently to estimate their rec h correct 5 
their classes, nor to Шан а ру ай 
the difference in images геЙе 
ferent classes, не 
15 аш 
might 
ed; 
sent in^ 


d 
This experiment, as has been noted, 


The results have been pre 


n Class size research. ine 
ize studies have been СОШ ent. 
Most class Size studies hav 


В „дәй 
| statistit 
al test is referred to George М. Snedecor, 
Pe 28) гр. 


“ 


y 


December, 1954) 


This is not to 
е discarde 


48 Class response to the instructor. But 
argued that most measures of pr- 
the “Өвөө nt estimate only the bare skeleton 
i Ё tonal process, Moro important be- 
Changes changes are unmeasured and these 
a nstitute the essence oi education. 
as it ioc of educational change, insofar 
eral, the Pe dra to personality change in gen- 
lonship of teacher to student has 
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often been noted as an important factor. It has 
also been noted that learning is facilitated by a 
favorable environment. Not the least of this en- 
vironment is the teacher himself. The emotion- 
al response to the teacher is an iniportant con- 
comitant of the learning process. Insofar as 
there may ре a relationship between the educa- 
tional process and the image of the teacher in 
that process, it would seem important to inves- 
tigate further not only this relationship but also 
the effect of methods of instruction, size of class, 
and class-instructor interaction upon the image 
that students have of the instructor. 
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SOME EDUCATIONAL IMPLICATIONS OF THE 
INFLUENCE OF REJECTION ON ASPIRATION 


LEVELS OF MINORITY GROUP CHILDREN 


REGINA M. GOFF 
Morgan State College 
Baltimore, Maryland 


THIS ST UDY is concerned with the social 


r 
заш Of rejection as it acts as a barrier to 
Rinorit intellectual and social functioning 01 
Sider ч Sroup children. The purpose is to con- 
аниц ны іп guidance which may offset 
Jection eus Lb Beton patterns which follow re- 
80816 o Which subsequently interfere with 


5 rejecto qi ation levels of the individual who 


et я | | 
State w erm is used in the sense of a feeling 


Overt жы represents a response to specific 
activities Е Patterns such as реше barred гот 
Others. and institutions freely attended by 
dispatehi e act of rejecting is essentially a 
individual 01 annoyers to which the designated 
Sum tion responds with discomfort. An as- 
е effect ^de is that attitudes have а pervas- 
9n behavior: that goals personally an- 
ects attiin ап “inner structure’! which 
Equent ip of confidence; that experiences 
Press attit О the original goal-setting may de- 
of antics and thus deflect the individual 
i the 50а Pated paths leading to the attainment 
tee the self „шег, ways of thinking concern- 
the S Of soos, ome habituated through time in 
78 learns cial reinforcements, The individual 
розі to place values on himself in terms 
s Чин, negative experiencing. It is the 
ee how educational ехрег- 
ibute to positive conditioning 
ед щ апау to the seit. 
: H of the problem, there is present- 
ү ёхрїогаНоп of the probable strength 
1 аппоуегз and interferences through 
amon, Of chils the picture which a designated 
thers Other ней have of themselves, including, 
беу iliti hings, their own evaluations of 
et, © Set and the concomitant goals which 
Mem pal achi, This is followed by a considera- 
Stren FS of үрү ent as it is found in adult 
reat or. 6 Same group, The probable 
ор вод Yances іп forestalling Ше real- 
5 may be indicated by the consist- 


With „ау со 


1, 


егвопа 


ency or discrepancy existing between goals of 
young group members and actual achievement 
as it is found in mature members of the same 
group. The approach thus followed includes, 
a presentation of original, impirical data onthe 
children studied and a summary of the findings. 
Next, а comparative statement of the status of 
adult members of the same group, and finally 
interpretations and implications with reference 
to offsetting the effects of rejection. 


Description of the Study 


One hundred twenty children, including 60 
boys and 60 girls were interviewed in Durham, 
North Carolina, in the summer of 1951. Rep- 
resented in the group were 6 to 8 year old child- 
ren and those aged 12 to 14. Equal members 
were in each group. Two age groups were used 
in order to note any changes in attitudes or out- 
look during the years of growing "ei қанын 
deepening perception, the acquisition of new 
knowledges, and new realizations concerning 
individual abilities. Upper and lower income 

roups are also represented in recognition о 
the fact that individuals in different social and 
economic groups “ас! in response to their cul- 
tural training, to their particular system of so- 
cio-economic rewards. "2 Contrast in social. 

гепсіле and training result in subjective іп- 

мт апа emotional reactions whichresult 
tel nter in thought, feeling, and action. 
ы: estions asked centered around successes 
бе pa in competitive out-of-school activi- 

ies (games and sports) in which they freely en- 
ties T ranking of the self in relation to in-school 
[eem performance; ambitions, goals or as- 
aca tion levels, and major wishes held. Where 
pira a himself, reflects personal feelings 
B Prentialities, confidence, and worth of selt. 
of Patton or goals are natural consequents of 
Br evaluation: That there may Бе wishful 
thinking rather than objective, realistic evalu- 
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ations, is a possibility. Nevertheless, such 
thinking furnishes a basis for action. In-school 
and out-of-school performances were consider- 
ed to note any possible differences in ranking of 
the self in freely chosen activities and those 
which are adult imposed tasks, Wishes, reveal- 
ing unfulfilled desires or ‘formulated aspira- 
tions” indicate sensitivity to lacks. This ego 
involved sensitivity provides vulnerable areas 
in personality structure on which negative pres- 
Sures may make immediate and noticeable in- 
roads. 

The qualitative data from the interviews are 
categorized and later quantified in terms of per- 
centage in various categories. In order to ob- 
tain significant differences in responses accord- 
ing to age level and economic bracket, where 
appropriate, the chi-square technique was em- 
ployed. 

In giving results obtained, it is recognized 
that 6 to 8 year old children, because of limited 
experience, may present fanciful conjectures, 
Nevertheless, if such should be the case, it is 

„по! amiss to place credence in responses inas- 
much as phantasy has its origin in experience, г 
real ог vicarious, and thought patterns e merge 
from such content, It may be added that 12 to 
14 year old children may voice social expecta- 
tions or approved-of-goals rather than true in- 
dividual expectancies, However, in 46% of the 
cases, the ambitions of children differed from 
parental expectations of them which might indi- 


cate some genuine personal concern on the part 
of the subjects, 


Statement of Findings 
ent ol Findings 
1. Competenc 


^om] Yinin-schoolandout-of-schoolac- 
tivities 
A 


rease in age, (Signif- 
of probability, ) 

У in relation to School 
in the low inc ome 
2 мэ girls at each а ge 
petent, while 63 of the 
younger boys ала 37% of the ds hadfeel- 

1С Success, 


icant at те. 01 level 
inadequac 


here уаз nó Signi 02 level or probability.) 


ic i А 
els of Confidence ех an difference їр 16у- 
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ive statements concerning А АЕ 
activities. Statements such as “мунет 
do as well, " ‘Sometimes, ” шань Lp 5 

Е. Results obtained indicate that feeling3 š 
worth exist to some extent in all Лара” 
and аге found most often іп younger ed 
ren. In the upper income group, ээ ЁН 
rank themselves as equally шин poem 
better than their peers more € ее 
they rank themselves as decisively 
capable. 

F. qme income girls hold least fee 
assurance and self-esteem. 


lings of 


ding to 260» 
IL Ambitions held, presented according 10 


Gag 
: "дег of fit 

sex, and income level and in order 

three preferences 


(26%); brickmasons, ри 
mechanics (24%); lawy Il players 
12 - 14 —Big league ba 
(40%); doctors (27%); соп 
builders (14% и 
Girls: 6 - 8-Теасһегв (34%); 
stars, dancers, models 
cooks (14%) С: 
12 - dae РИ (300); 15%; 
Stars, dancers, models ^ 
secretarial activities (10% 
B. Upper income group: 
Boys: 6 - 8—Policemen ап - 
(34%); builders and e 
(32%); agents in real 
fices (14%) ers 
12 - i4—Doctors and ачу cis! А 
(46%); scientists, “ р nitec 
“chemists’’ (20%); аг 
(1%) а 
Girls: 6 - 8— Teachers (34); ^ 
(26%); home makers: " 
(24% 1%); mov 
12 - 14— Teachers (3 ea) " 
stars (27%); secretaries ` com 
C. Seventy-nine percent of мэ 
boys and 33% of the girls is а oF | 
would reach their goals, i 
upper income boys and Ө. 
made decisive statements d money а себ 
D. Lower income children ће зреет а 
lack of opportunity ав poet та ав? 
while the upper income ӨП вс» ай 
ill-health, physical disabili tio 1 
апа death as possible me jeas oces" 
E. Lower income girls expres Ба gu 
curity with reference to pro 


movie 
(15%), 


а firemen 
hanicS 


n 
газвита һ4 


іп 

Ш. Expression of wishes presented ! ) 
first three choices "ms 

А. Lower income group: ish е®Р 
Boys: 6 - 8—Toys (Only V! 


December, 1954) 


12 - 14— Money, clothes 
Girls: 6 - 8—Clothing, food, homes 
12 - 14—Improved physical ap- 
pearance, homes, families, and 
money 
B. Upper income group: 
Boys: 6 - 8—Toys, pets 
12 - 14-А wide spread of desires 
was reported from the acquisition 
of Eagle Scout badges, success 
in occupation, money for philan- 
thropic purposes, to more sober 
wishes for good health to eternal 
| Ше 
Girls: 6 - 8—Toys, pets 
12 - 14—As above, wishes were 
divergent with no heavy localiza- 
tion in any particular category. 
These included distribution from 
personal luxuries and travel to 
fulfillment of social needs; “places 
for colored children to swim, " 
eux d rinks, admittance to the 
“hie l; 
с. я ig library. > 
Particularly in the lower income group 
in wis indings Similar to those of Gray 
Wal ich wishes were more іп terms of the 
ыы апа concrete than in terms of the 
Tact; happiness, health. 


Su 
пагу of Findings 


A 
теа, ance at trends throughout the findings ге- 
қ Straignt В reference to lower income girls, 
1 levels ^ relationship between low confi- 
Selin : S, little anticipation of success, and 
gets whi deprivation as revealed by wishes in 
эс СА contribute to inner securities. Sim- 
өлш continuity appears to run 
Аде of „dings with reference to Ше re- 


No Config 
fee: Positive ^ 
геср ntl ja 
Чарс towarg 
fon eco, Е 

Orm nomic 


ni 
Energ ІМ аге 


псе аге expressed more often than 
ttitudes of competence exist more 
п negative ones, ambitions are di- 
Occupations which yield substan- 
Téturns, success in areas of per- 
are 11084 often expected, and wishes 
Wh е in terms of further вей-епһапсе- 
ile | 
hese Children have no doubt exper- 
tion in their movement in the 
e 2. they evidently see them as isolat- 
су context of life of the future. Pug 
Spig Of the ; З at these ages no generalized по“ 
Sodes `Š impact Which а totality of oper] 
е lar n the 
9 „агвег world may have о ] 
K эор оп, When asked to state соп 


might interfere with the realiza" 
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S of the group reporting. Ingeneral, feel- 


қ 181 


tion of goals, but two mentioned rejecting ех- 
periences and conflict in inter-group relations 
although a much larger number had no doubt ex- 
perienced unfavorable situations. 


The Adult Population 


If we now turn to the adult population of Ne- 
groes in American life, we find but 2. 675 of the 
total group in the professions with more than 
half that number in the teaching occupations and 
the remainder spread thinly as doctors, trained 
ministers, and lawyers. Discriminatory and 
rejecting practices in industry have leveled the 
ranks of Negro workers to unskilled and semi- 
skilled employment. Hardly 5% of the total Ne- 
gro population can be considered in the upper 
income bracket. How much of the discrepancy 
which we note between children's confidence lev- 
els, their ambitions and wishes toward improve- 
ment and adult reflection of lack of fruition of 
these can be attributed to outright techniques of 
economic and social discrimination and rejec- 
tion, or to misjudgment of ability, and how much 
to apathy or a giving up in the process of devel- 
opment is hardly discernible. Yet, the question 
appears worthy of consideration. Itis highly 
probable that aspiration levels are lowered, con- 
fidences shaken, and wishes abandoned because 
of psychological omissions in training and guid- 
ance. It is also likely that much by way of pre- 
vention of wastage of ability and warping of per- 
sonality could be achieved if, before their іпсер- 
tion, effort were made to offset negative attitud- 
inal patterns which are barriers to achievement. 
While the Negro group уаз used for the illustra- 
tive purposes, it would appear appropriate to 
assume that the same principles apply to any 
individuals in comparable unfavorable situations 
for common causes are present despite other 


variables. 


Interpretations and Educational Implications 


As indicated, lower income children showed 
a marked feeling of inadequacy inre lation to 

hool subjects. It is possible that attitudinal 
ies сак stem most directly from early home 
~ cultural influences. In other words, these 
нэ мээн have learned a particular response pat- 
ши тһеу һауе по social heritage akin to schol- 
arly production, nor perhaps do they even have 
family exposures which reflect a tradition of 
schooling. Such omissions generate an unfam- 
iliarity with abstract symbols and attendant feel- 
ings of shyness concerning them. The discern- 
ible trend to feel more at ease inphysicalgames 
and sports may be worthy of attention. The school 
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might recognize the role of feelings of compe- 
tence in physical activities from the point of 
view using these initial security reactions for 
the development of generalized feelings of ade- 
quacy. Praise and commendation following suc- 
cessful endeavor in deliberately chosen games 
which require thought as well as Skill, with this 
requirement pointed out to the child, releases 
latent streams of inspiration which invoke moti- 
vation to tackle problems with similar require- 
ments in other areas. А greater measure of 
Successful anticipation will accompany effort, 
and early tendencies to feel incompetent in rela- 
tion to diverse tasks will be eased. 

Incidentally, a factor influencing attitudes 
toward success in out-of-school activity is ab- 
sence of adult dominationandcensure, The child, 
relieved of the tension of straining for goals set by 
adults unreservedly directs attention and enthus- 
iasm to the experience at hand. Also, he prob- 
ably chooses those activities in which he has 
demonstrated his competence. Teachers might 
well assume a ‘‘background”’ or ‘‘hands off” at- 
titude, thus avoiding unnecessary intrusions 
which set up emotional restraints. 

The discernible trend of decrease in confi- 
dence level with increase in age in lower income 
children has implications for the basic problem 
—the probable force of the impact of rejection. 
Greater receptivity, less resistance to social 
depressors characterize the individual who al- 
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which give status in the respective groups. ша 
in turn provides satisfactions which bolster 
ego. е 
Б Older upper income boys revealing less d 
fidence than girls in the same group, no ер! 
һауе a greater attunement with reality. Он 
is more movement апа mingling outside an, 
home and classroom with greater apponi M 
for sharp person to person comparisons Р 
creased awareness of group standards. 
looks, as a result, are less hopeful. io gomë 

As indicated, feelings of worth exist i fost 
extent in all groups. Where found, сне urity 
tive attitudes may be thought of as “56 figura" 
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number of picture magazines and урж 
high-lighting activities of the world она made- 
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Ап influence, too, тау be Ше recen ы previous" 
a few Negroes in occupational avenue? E | direc 
ly closed to them. Ап indication of Me pe lief$ 
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A question sometimes arises УН ing chi d л 
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full view of the social world of i uper ин 
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or a child of a minority group m whose P, 
be invited to play with some children | not юэ” 
ents consider them better; that he restaura" де 
allowed to enter some theaters and no wele ор" 
that adult members of his group аге "^ ре рот ср 
to live in some neighborhoods ап d firms ие 
ed out; that there are industries wa ој und" 
will not hire them? Is there а risk чет! s 
planting seeds of inferiority and а ack up? 
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STATISTICAL ANALYSIS OF SCORES FROM 
COUNTERBALANCED TESTS 


JULIAN C. STANLEY! * 
University of Wisconsin 
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die ted means provides an answer to 
be However полей, 
te Quite ineffi he use of independent groups may 
be Scores f nb since the correlation between 
Бо high, Te Ог the same individuals will often 
s mage only one group of children with 
пее signifon and then using analysis of уаг- 
© 5һоц ance tests for correlated observa" 
notes Some Ж more efficient. This metho 
nic, Sncounte ifficulties in design and analysis 
q Que, but red with the independent-group tech- 
чау и еве are not serious enough to dis - 


e Uncor 
the quest 


о е Sim 
Шу two Plest design of this sort occurs when 


te; te 

ae Should p аге being compared. These two 

Нац 4 T to x е administered in counter~balanc~ 
9 andom halves of the total g rouP- 


S А 
юү Ше s-p bjects Should be tested first with, 
апа second with the WISC; the other 
Sd wit, Уау sese the WISC followed by the 5-В. 
"Тара the qi dence effects will not be confound- 
Er още а Subj ference in difficulty of the two tests- 
оцу an бол. at random from Ше S-B, WISC 
L. ЭР results а random from the МВС, 5-В 
аз үр еге Will in the simple latin square of Table 
Шаһ еге аге Бе half as many such latin squares 
t j ав ther, ibjects in the investigation, ог 25 
апа] Ore ее are individuals in either group- 
Org Sis in р enient to set up the scores for 
tion (5 аге ker form of Table II, where the two 
Таро! D lat Єр separate, This is a consolida- 
е үг “tin squares like the one shown in 


478 V 


The Table II scores can be analyzed for or- 
ders, individuals, tests, and sessions (first 
test versus second test) by a method set forth 
in considerable detail by Lindquist (17:273-81), 
Edwards (3:319-27 ; 4), Walker and Lev (24: 
373-81), and Grant (9:428-32;10). Apparently 
the design has been applied to this type of prob- 
lem only by Gellerman (1), who extended it by 
matching his two order groups individual by in- 
dividual (1 with n + 1, 2withn+2,...,0 
with 2n) on other variables but failed to take 
this additional source of correlation into ас- 
count when analyzing the scores. 

There are the following degrees of freedom 
s of Squares from Table H: 1 each for 


for sum I 1 
tests, orders, and sessions; 2(n - 1) for differ- 
ences between individuals of the same order; 


and 2[(n 7 1)(2 - 1)] for the “residual within 
individuals, ?? which is the individuals of the 
same order by tests interaction pooled for the 
two orders. These 4.1, add to 4n - 1, or N- 

1, the usual sum. The proper “cerror” term 
tor orders is the «differences between individ- 
uals of the same order" mean square. Forses- 
sions and tests the ‘‘residual within individuals’’ 
mean square is the appropriate divisor, The 
reader interested in the rationale of the analy- 
sis should consult Cochran (2), Edwards (3, 4), 
Grant (9, 10), Kempthorne (13:Ch. 29) and 


: ist E 
acm examples of counterbalanced designs 
involving two tests are the studies of Frandsen 
and Higginson (6), Gerboth (9), Holland (12), 
Krugman and others (15), Kutash (16), Pastovic 
and Guthrie (19), Peel (20), and Vanderhost 
and others (23). Hays and Schneider (11) ет- 
а more complex counterbalancing pro- 
with 16 independent groups. With the 
single exception of Gellerman, noted above, it 
appears that no test investigator has used the 
general type of design shown in Table П, though 
in at least eight different studies it would prob- 
ably have been more appropriate than the sta- 
tistical analysis reported. Since no textbook 


"Қо 
tes wi well as the bibliography 
be article as phy o 
mu found at the end of the ic. 
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or article makes thoroughly explicit the proced- The Frandsen-Higginson Study 


ure for this particular psychometric design, let 
us work through some data based upon the Fran- 
dsen-Higginson (6) report, showing both the Originally, Higginson tes 


correct and incorrect way to analyze it, The children, 27 with the 8-В first and the ees 

writer is indebtedto ProfessorArdenN, Frand- second and the other 27 with the WISC шанг 

sen for thesescores. the S-B second. Order and score informa? 
TABLE I 


THE ELEMENTAL LATIN SQUARE IN A COUNTERBALANCED TESTING STUDY 


— m 


Orders Individuals S-B WISC 
S-B, WISC A S-B First WISC Second 
WISC, S-B B S-B Second WISC First 


— —— i E s 


TABLE П 


COUNTERBALANCED TESTING WITH THE S-B AND WISC 


[a Wiese ананы. 


Orders 1075 
о Ж” шше 
(Groups) Individuals $-B WISC 
U Ps s P НИНА 
1 First test Second test 
2 First test Second test 
S-B, Wisc 

n First test Second test 

nei Second test First test 

WISC, 8-в n+2 Second test First test 

2а Second test First test 


— © semie Fuse 


ted 54 fourth-grade 


(Vol. 23 


March, 1955) 


іог А 
ег; а 54 testees was furnished Ше writ- 
oy: bene аре d of testing was 
other testee p of inquiry. By discarding an- 
uals left andomly the writer had 50 individ- 
lined in Map OB a total of 100 scores, as out- 
ing the ра Ш. Table IV shows how analyz- 
Priate пувта Separately is related to the appro- 
oth orders analysis, which permits tests of 
Viduals Гон Sequences, as well as of indi- 
he chief = always significant) and tests. 
Which with | о ле is an Е of 6.77 for tests, 
Nificant bee 48 degrees of freedom is sig- 
Sing high een the 5 and 1 percent levels, IQ’s 
the 25 «coe the S-B than on the WISC. И 
against the 35 [01 Фе S-B taken first are tested 
"andomizeg 4 Tor the WISC taken first (a simple 
а consig esign), the Fi 48 = 641/177 =3. 6, 
та ве ен loss of precision. 3 
Ще is ры of 25. 00 for sequences іп 
Мы һі бай than the residual error term, 
is lice effe Y surprising because the average 
5 -1.00 IQ Ct inferred from Table Ш means 
ЛБ ns, 105 es de Also, the two order (group) 
antly уре; 56 and 102. 74, do not differ signif- 
"Ong indivi Considered in terms of variation 
lo Six - within orders. 
WS from o. of squares are secured as fol- 
figures in Table III: 


9 2 : г 

ї00{ [(5319)*.(5131)*]-(10,456)*] 2331.24. 
(во 

:213,516)-((5319) 44513791 = 

12, 647.40. 


sts= 1 
"I ig 1069) (во? -по вой) Ж : 
09.16. 


55 
Ss 
51 2 
ost [5253)*.,(5203)*]-(10,456)*] =25.00, 


58 
SR 
(o 
: m (974,7684534.020)-25(2,212,516)- 
6 a 
) +(2603)? + (2600)2+(2537)2 ]+[(5319)°+ 
(5137) | ) 22106.24. 


[IB 


Које 1 

Saks 

TopL190(574,7684534,020)-(10,456)" ]- 
15,508. 64. 


во Gr 
tes, ал (9. 
et i: are 1430) has pointed out, when only 
Bets (teste Sing compared, each of the three 
МУ Conto, orders, and sequences) 15 com" 
Ae не e with the interaction of ын 
" {Чени ог 
due” is jq, P efore, the sum of squares 
"ntes оса with that for the orders X 
action: 
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106 (2716+2600-2603-2537)? = 309. 76. 


Also, the sum of squares for “огдегв” is 
the same as the sum of squares for the tests x 
sequences interaction: 


uo (271642603-2600-2531)* = 331.24. 


Likewise, the “sequences” sum of squares 
may be secured via the orders x tests interac- 


tion: 


an (211642537-2603-2600)* = 25. 00. 
1 


A little reflection will convince the reader 
that these relationships are quite reasonable, 
For example, the orders x sequences interac- 
tion will be significant only if the mean of the 
8-В taken first minus the mean of the WISC tak- 
en second differs significantly from the mean of 
the WISC taken first minus the mean of the 5-8 
taken second: 

(Ms-p, "Mwisc) ^ (МБС, ” Mg-p,. This 
may also be written 

(Mg-p, *MS-B;) 7 (Мулас, + Мулвс,), 5һо%- 
ing that the ох S interaction is equivalent to the 
«tests main effect (S-B versus WISC) when only 
two tests are compared. | | | 

If just the «tests effect is of interest, as in 
the Frandsen-Higginson study, the mean differ- 
ence between S-B and WISC scores of the 50 
testees may be tested for significant deviation 
from zero somewhat more easily than in Table 
IV. Obtain the 25 differences (say, S-B -WISC) 
for each order and the sum and sum of squares 

the two sets of differences. Then 


for each of 
| z ) | 
=D 
bic 


619. 52 6.17. 


identical with Ше Е for “tests” in 
put note that both numerator and de- 
nominator of the F-ratio are twice as large as 
the analogous mean squares of Table IV. 

The statistical procedure used most often in 
udies employing two counterbalanced tests is 
-test for the significance of the difference be- 


This i$ 
Table ТУ, 


st 
at 


TABLE IV 


(8661 “әлеу 


COMPOSITE ANALYSIS ОЕ VARIANCE OF FRANDSEN-HIGGINSON (6) DATA 


Source of 


Orders 


(tx s) 
Individuals 


Tests 
(o x s) 


Sequences 


(хо) 


Residual 


G xt) 
Total 


ж р < .001 f 331.24 


Sum of Squares 


1,412.28 + 5,175.12 = 12,647.40 


255.38 + 19.38 Z 309.76 
жаз жб К 25.00 


1,492.12 + 1703.12 = 2,195.24 


9,219.78 + 5, 957.62 # 15,508. 64 


жж 01 «Р «.05 263. 49 


Degrees of Freedom 


24 * 
1 + 
24 + 


= 48 


Variation | S-B First | WISC First ЕЕ First | WISC First | Overall | S-B First | WISC First 
š Е ge P 


Mean Square 


Overall 


331.24 F=1.26f 


263.49* Е = 5.76 


255.38 79.38 309.16# Е = 6.77 
ағат ко | s = вунене 25.00 
62.17 29.30 45.13 


АЯПМУ15 


| 


тет 
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tween the correlated means, ignoring both order 
and sequence. This amounts to lumping the or- 
der sum of squares with the sum of squares for 
individuals and putting the sum of squares for 
sequences into the residual term. IntheFrand- 
sen-Higginson investigation such consolidation 
makes little difference, since neither orders 
nor sequences contribute much variation. Where 
the two groups are randomly selected halves of 
the total sample utilized in the study, theorder 
effect will probably be great only if experiment- 
а1 controls differ considerably for the two groups 
or the two tests are quite different in contentor 
difficulty, so that taking a particular one first 
facilitates work on the second test much more 
than taking the other test first would do. When 
this latter condition holds, the analysis of var- 
lance is vitiated (see 13, Ch. 29). As will be 
Seen later in this paper (Table V), sequence 
(largely practice) effect may be a huge source 
of variation. 


Estimation of Test Means 
= enn of rest Means 


The counterbalanced design of the Frandsen- 
Higginson (6) study permits us to estimate that 
for this fourth-grade group the 5-В 1075 run 
106.32 - 102.80 = 4.52 
full-scale 10%. 


gible, these two means may be taken to be equiv- 


had all 50 subje 
other of the tes 
nificant, howey. 
accepted as su 


: ng representative Schools, " but 
they did not men е effectas a possible 


Estimation of г?з 
—— 


Coetficients of : 
tests should be р, Correlation between the two 


computed from the 


о = 
tice effect lowers И, LH а while prac- 
Son (6) study the vazio are, Sen-Higgin- 

8-8 first" group; „7678 tor to 1069 for the 


group; .7329 Overall; апа 1285 9, WSC first” 


Thus in this instance thi thin groups,4 
: е 
difference whntsoeyer in абсо porn ж 
cima 


(Vol. 23 


place, but there are probably many Bn em 
where the overall r will be considera ич С 
ent from Ше within-groups г. хэвээ x 

this discrepancy will be given in Tab е, іш 
X represents апу score on опе test 2 ыы 
Score on Ше other, Ше Prandsen авии эр 
within-groups г may be computed dire 

Shown at the top of page 9. 


Estimation of Standard Deviations 


py dif- 
Standard deviations will be affected OY есь 


ferences between groups and Бра. esti 
being increased by both. An unbi may 


of the population variance of E figure in thé 
be secured by taking the 232, 54 t the top of the 
denominator of the computation а 4200. 


2 
or 
next page and dividing it by 2(24) (25), where n 
The divisor in general is 2(n 7 1) a in 4 
represents the number of individu. unbias@ 
group. To obtain an approximate Ч deviation: 
estimate of the population sania ico. 
extract the square root of the а A 

To recapitulate: Counterbalan псев betWe 
yields a direct estimate of differen abo. 
forms or tests, since each is e oun t 
equally by practice effect, but ethods for e 
anced design calls for revised m and sta 
puting coefficients of correlation recia 
deviations if practice effect 15 APP ний, 
for a more elaborate significance 


rms 
More Than Two Tests or Fo 


а Three 
Three Forms of the Same Test ал 


Orders 


rm 
ing ап old fo ms 
During the process of «баасан two new a 
(A) of a certain aptitude test 7 assist?” 
(В and C), the writer and неее de роу5 
tested 30 eleventh and twelfth зэв pala 
state orphans’ home in three 69°. iors git 
orders: ABC, CAB, and BCA. Ten Роуз: үре 
ВАС, and АСВ were not used. D ord 
from the eleventh grade dnt о еас ес? 
tweltth, were assigned at мөр Ñ 
One test was given each day e rdized con the 
tive days under carefully siana arint ter 
Table V shows the analysis О and day di? 002 
90 scores. Individual, form, beyond d {07 
ences аге all significant well 54/345. 


а 


” 


| ! 2 
level, while Ше Е ratio of ын ” аб, 
Order means is not significan nalyze ш 10% 

Some investigators would à jon € гард 


ification ^ д 
by ignoring the “огдег” classi e o ИРТ, je 
and performing a two-way ana Т itself watt.) 
(individuals and forms). boe well C? (аау зе 
ably of little importance in MOS e effect со, бар 
Studies. However, when pra 118 
is a large source of variation, 


+ псе 
Significance test for the differe 
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= 


ТАВЬЕ У 


ANALYSIS OF VARIANCE OF THREE FORMS ОЁ А TEST ADMINISTERED IN THREE 
COUNTERBALANCED ORDERS TO 30 DIFFERENT INDIVIDUALS, ONE FORM 
EACH DAY FOR THREE DAYS 


Sum of Squares d. f. Mean Square 


199.54 


a: 399. 0889 3 19.54, 
iduals withi 3 9335. 2333 . 
Forms т ордена 4361, 6889 2 2180. 84% 
c (Practice effect) 3509. 3556 2 1154. 68* 
ms x days i š мал 
а декан уз interaction within 6.1556 2 3.08 
€sidual (individ Е 
uals within 
Orders x forms interaction)? 2373. 4667 54 43. 95 
ма 19984. 9889 89 
* 
өт du (8:324-326; 4) 
Or discussi я indquist (11: 218-281) and Edwards (3:324- 6; 4). 
Lindquist СЗ eod Se а interac ion sum of squares into two independent 
onre orders, which is equivalent to the 


| compone: : 
| LC rene не ato jon within orders. Edwards di- 
vides the иа I an E оп into days and а “Тайп square error” remain- 
orms intera error is not likely to be а significant 
Sourc гн ‚ 435-431) calls it ““вацаге uniqueness М 
е of variation (3:326; fn. 10). 29 алын or not “it has been inflated ог de- 
е шггей in the interactions of this 


each with 18 d.f., are: ABC, 


The i $ ers 
residual sums of squares for me бъка or ets test of homogeneity (21: 250) 
2165 which corresponds a P of approxi- 


with 2 d.f., 


“- 
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TABLE VI 


DISCREPANCIES BETWEEN 1'5 AND BETWEEN VARIANCES COMPUTED FROM 
OVERALL DATA (ORDER IGNORED) AND FROM POOLED WITHIN-ORDERS 
FIGURES FOR 30 TESTEES TO WHOM WERE ADMINISTERED TEST 


FORMS A, B, ANDC 


C -— .. UU UU 


Statistics 


Overall Within Orders 
ТАС „49 ‚81 
Ївс .40 . 62 
B 200 154 
с 


153 101 


ТАВГЕ УП 


А GRECO-LATIN SQUARE DESIGN, WITH n INDIVIDUALS PER GROUP 
(TEST FORMS А, В, AND C PRINTED ON GREEN, WHITE OR 
YELLOW PAPER) 


—. u 


First Second Third 
Group Session Session Session 
Р ес 
ва АҮ cw 
3 
СҮ BW AG 


(Vol. 23 


Магеһ, 1955) 


‚ Dwithin = 


means would 


lose much power, since the sums 


50 25 25 50 50 
255 XY - (XZY + EXZY 
үлі GEM 222 
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50 25 50 
2 |4 2521° - | СУ) + (БҮ) 
1 1 26 


25(551, 864) - [(2716)(2603) + (2600) (2531) 


222 25651,86ф - [(2716)(2608) + (2600)253)1_ 
{ 25(574, 768) - [(2716)? + (2600)? J] {25(534, 020) - [(2603)* + (25372) ) 


130, 752 


У (232,544)(138, 522) 


50 25 50 
255Х2-1(ЕХ) + (ЕХ) 
1 1 26 


y summarized іп Table V had 


Form A in the stud 
limit than Forms B and 


21 Squa. A 
interactio, tor practice effect and “Чогшв xdays not had a shorter time 
e residual шіп orders” would be pooledwith C, it would have been feasible to use five sub- 
term which ; ОҒ Squares to form а new error jects for each of the six possible orders and to 
TMS is 2180 too large. In Table V the F for test all 30 individuals in the same room 
.84/43.95 = 49.6, with 2 and 54 with the three forms during a single day. Each 
d randomly to a seat in 


Sl, while 


the inappropriate ratio is 


person could be assigne 
pair correlation caused 


order to prevent inter- 
Cheating would be min- 


by friendship pairing. 


(9509-3556 2180. 84 
+ 6. 1556 +2373. 4667)/(2 + 2 + 54) = imized so much that subjects could sit in adja- 
cent seats, rather than only in alternate ones. 
2180.84 _ 91,5 Experimental conditions would be controlled 
р 7101,58 7” better than when each order group was testedin 
With 2 and ` а separate room. It would even be feasible to 
Чу eith 58 4.1. Of course, in this particular use the 24 permutations of four forms or tests 
qj ond el F (49.6 or 21. 5) is significant far if enough subjects (at least 48) and a large 
Шегепс +001 level, but in some situations the enough room were available; two subjects per 
е Would be important order yield 1x 3x 24 = 72 d.f. for testing the 
š “forms” and “sequences” effects. 


Hi Е е геад У 
!&Bins ег Will recall that in Ше Frandsen- 


Уат Son 
хасе ану, coefficients of correlation and айп Crossover Designs 
Were ог ders ог Е Ме, whether computedírom Greco-Latin Crossover Designs 
Bible, (ага » Since the order meon and Lev (24:377-381) illus 
ДБ 5: Bosna and practice effect was negli- аа г. хэмээс Lise dien хүн на 
Varia Ways true Table VI will show that this form a greco-latin square. This is not ровві- 
Syste Ces бор the | however, since the r’s and ble with a 2 X 2 design; at least a 3 х 3 setup is 
being atic disc е 30 testees show consi de rable uired. Suppose that in the three-form equat- 
ang 3 "огу Paneles, the within-orders r's не; study three different hues of paper—green 
e ur зе де ug than the overall figures (G), white (W), and yellow (Y)—had been used 
Ац баны rS variances lower. is make the design of Table VII, where A, B, 
ые Orders and С represent the three different forms of 
" Grant the test. Each letter occurs once in each row, 
which а (9:432-434 — once in each column, and once with each other 
ere АЦ si ) discusses an experiment letter, assignment being random within the lim- 
of рее oyeg mutations (orders)of three things its of ‘these restrictions. Preferably, assign 
Such ва бора Stating that ‘‘when complete sets ment of individuals to groups would also beran- 
ot оо of sq ез used, а! interactions n dom in the types of studies discussed here. The 
unded with the е (р. 434). If degrees of freedom are: sessions, groups, 
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TABLE VIII 


А FACTORIAL CROSSOVER GRECO-LATIN DESIGN 


= 
School Grade 


or Class Sex Orders Individual I п ш 
1 
Al B2 C3 
2 
M 
Тї 
В1 АЗ С? 
” 72 
- 73 
Al B2 C3 
74 
F 
143 
ВІ АЗ C2 
144 
145 
Al B2 C3 
146 
M 
215 
ВІ АЗ C2 
M 216 
217 
Al B2 C3 
218 | 


B1 A3 C2 
288 
289 
Al B2 СЗ 
290 
M . 
ннен RR 
w B1 A3 C2 
= 360 
3 
Al B2 СЗ нь 


[3 
March, 1955) STANLEY | 


TABLE IX 


ES FROM TABLE VIII 
DEGREES OF FREEDOM FOR THE VARIOUS SUMS OF SQUAR 


= 


Total between individuals: 432 - 1 = 431 


Orders; 36 - 
Sexes: 2 
Grades: 3 
Grade x sex x order: (3-1 
Grade x sex: (3-1 
(3-1 
(2-1 


ини 
_ 


Сгаде х огдег: 

Sex х order: 

Individuals within - 216 
Orders: 3(2)(36) [2 1 Ч) | 


= 864 
- 1) = 2(432) 8 
Total Within individuals: (432 - 1)(3 7 1+8 4 


Roman numerals: gelar 
mus letters: 3 Е | =f қ 
га с numerals: “ь- -1)-4 
Grade х sex x roman: (3 - 1)(2 7 Це - Ü =4 
Grade х sex х latin: (3 - 1)(2 - 18 -1) 44 
Grade x sex x arabic: (3 - 1)(2 д 1-4 
Grade x roman: (3 - 1)(3 -1)=2 
Sex x roman: (2 - 13 1) -4 
Grade x latin: (3-1)3- 1)-2 
es X latin: 8 7 НЬ Л 1) -4 
rade x ic: Е = - roups: 
Sex x hen (2 - ЫН е pis T cmd 
Individuals x roman numer 


-1)| = қ 
2 - 1)(3 я -вех groups: 
essc SOS within vA - (3 - 1)] = 396 
€sidual order х rom 


3(2)[(36 - 0G 7 


(3) - 1 = 1295 


Total, 3(2)(36)(2) 
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forms, and hues, 2 each; individuals within 
groups, 3(n - 1); residual (individuals х 5е5- 
sions interaction within groups), 3 ((n - 1)(3 - 
1)]; and total, 9n- 1. The interested reader 
is referred to Walker and Lev (24: 378-381) for 
Computational details, which differ from the lat- 
in-square design only in that the extra effec 5 
hue, uses up Ше two d. f£. which ina replicated 
3 x 3 latin square would be assigned to “latin 
Square error." Before anyone attempts to de- 
Sign studies of this type he should be familiar 
with latin and greco-latin square designs as ex- 
plained by Grant (9), Edwards (3:303-332; 4), 
Lindquist (17:258-265), Walker and Ley (24: 
373-381), and Archer (1). 
There are 36 different rows possible for the 

3 x 3 greco-latin square design. (In the types 
of studies discussed here these yield only 12 dit- 
ferent 3 x 3 greco-latin Squares, since the or- 
der of the rows withina particular square is 
immaterial.) А completely counterbalanced de- 
Sign can be obtained with just 36 subjects as- 
Signed randomly to the 36 TOWS. "This gives the 
following d.f., using the terminology of Table 
VII: days, forms, and hues, 2 each; between 
individuals, 35; residual, (35)(2) - 2 ~ 2 = 66; 
total 107. The basic 36-регвоп design ma y 
be replicated for the two sexes and in, say, 
two different school grades, yielding a total of 
(36)(3)(2)(2) ~ 1 = 431 d.f.: 2 each for days, 
forms, and hues; 140 for “between individuals 
within groups”; 1 each for Sex and grade; 1 for 
the sexes x grades interaction; 2 each for sexes 
X days, sexes X forms, sexes X hues, grades x 

YS, grades x forms, grades х hues, sex хо 
grades х days, sex х grades x forms, and sex 


{до ан іп most Comparisons of two individ- 
ua. a, tester" should be introduced as an 
K br analogous to “sex”? or “schools”? 

are utilized however, three test- 
ers may be made a “greek” variable like ie 
ш хэв уп. Since tester and test ave likely 
Considerably its i 
all 36 possible &reco-latin вене 5 pmi E 


Replication Within Orders 


Obviously, it is possible 
one individual for each i le тн. more than 
Sex group and thereby get wi n each grade- 


Ра ын ithin-, ^ 
tion among individuals, as outlined ie T. ms 
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ҮШ and ІХ. If just two individuals are tested 
with each of the 36 possible greco-latin orders 
for each sex and within each of three grades, 4- 
there will be 2 x 36 x 2 x 3 = 432 subjects need 
ed.7 The between-individuals-within-O r ach 
mean square has 216 d. f. The individuals В. 
man numerals interaction within orders ach 
(2)(36) [2 ~ 1)(3 - 1] = 432 d. £; the order ру, 
column residual within each grade-sexgro с 
(36 - IG -1)-2 - 2 = 66, which when sump 
over both sexes and all three grades yiel я ДЕ 
Presumably this **greco-latin square err. pen 
“square uniqueness"? will not be significan als 
tested against the individuals x roman A ДАЛ 
interaction, since all 12 possible greco rade” 
squares are involved in each of the она com" 
sex groups, so its sum of squares can numer" 
bined with those for individuals x roman Pi. 
als interaction to yield а “within” error 
mate with 396 + 432 = 828 d.f. — — by 
This design illustrates replication differ" 
using the same square and by employing ае- 
ent ones, thus combining the two E іне ре- 
Signs set forth by Edwards (3, 4) and 6 
yond the ones that Archer (1) proposes. 


The Krugman Study 
of the Ке 


In a counterbalanced comparison шал, 
vised Stanford-Binet with the WISC, Кр) used 
Justman, Wrightstone, and Krugman d girls a! 
various examiners to test both boys «t gis took 
ten different age levels, but their Tue dis 
into account only age (and not in the pig 
cussed here), A rigorous overall Ёс would be 
this type of study seems feasible. 4 testable Е 
complex, however, for there аге 2 wont thos 
main effects and interactions in айа де % 
involving Ше testing order (S-B firs e selected 
first). Furthermore, if testers wer ather шир 
randomly from a defined population jous шіхе 
only on the basis of availability, Ser? 
model problems might occur. t 

There is a limit to the extent Ша. ausinÉ _ 
designs may be elaborated without C іпіегргё 
grave difficulties in manipulation эв relevan it 
tation, but the writer’s survey of t this BP у“ 
journal literature convinces him m pym n 
has not been approached closely уе тай? 
Chometricians. In particular, the reek 
and Ше 3 x 3 completely permuted г 
over designs seem to merit consider 


r 
сгов50У6 


Summary 


s oV 
Psychometricians seldom use C r 0 геу е 
(switchover) analysis of variance РГ e 
€ven when they counterbalance tee. qao “ed 
plest of these designs, a 2 x 2 сотр ill аг 107 
the Stanford-Binet and Ше WISC, 181 n Big 
in detail with scores from the Fran 


of Нено unpublished scores from three forms 
permitted р test, is analyzed. Completely 
factorial e 2 and greco-latin designs, wi th 
n Оше ensions, are discussed. Тһе writ- 
Quite user es that crossover designs should be 
ul for comparing different tests or 


Se 
veral forms of a test. 


pha; He particularly em- 


Siz 
es the 3 x 36 greco-latin arrangement. 


si ë 

юэ 2 Variance Designs for Learning Stud- 

5 ale Бот зуоһопод1са1 Bulletin, XLIX (1952), 
© Cochrs 

ап, У. G., and Cox, Gertrude M. 


Exper;, 
wila вета] Designs (New York: John 
тасу and Sons, Inc., 1950). 
Sychol А. L. Experimental Design in 
hart ogical Research (New York: Rine- 
and Со., 1950). 


Чага, 
апа dud A. L. ‘Homogeneity of Variance 


ical Бона Square Design, " Psycholo£- 
“Рено, XLVII (1950), рр. 118-129. 


Sher ; 
Search V A. Statistical Methods for Re- 
OL orkers 


сл 
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FOOTNOTES 


ndebted to Mr. V. N. Amble 
ofessor Oscar Kempthorne for making 
elpful suggestions concerning an earl- 
of this paper. Theyare not, of course, 
ple for any errors ог ambiguities that 


remain. 


2gdwar 
terms 5: 
fore thei 


ds (4) points out that the two residual 
hould be tested for homogeneity ре- 
т sums of squares are combined. 
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62. 17/29. 30 = 2.12, to which corresponds a 
P of approximately 2 x . 04 =. 08. Similarly, 
the two sums of squares for individuals may 
be pooled, since F24,24 = 7, 412. 28/5, 175. 12 


= 1.44, while the F needed for significance at 
the 10 percent level is 1.98. The cautious in- 
vestigator may want to use Tukey's (22) test 
for non-additivity of row and column effects, 
also. 


Зтһе Standard deviationof the 8-8 first'' scores 
(15.45, shown in Table Ш) is nearly signifi- 
cantly larger than the “WISC first” standard 
deviation (10. 08), Р being . 06. 


tof course, before a pooled within-groups r is 
computed, the individual within-group r’s 
should be tested for homogeneity. Here the 
difference between . 7069 and . 7678 yields a 
CR of only 0.5 via Fisher's Z-transformation 
(5:203-204). If individuals are assigned to the 
various order-groups randonly, significant dif- 
ferences among comparable within-group r's 
Seem unlikely, though their possibility should 
be recognized, 


5This complete design is presented and discus- 
Sed in the Appendix at the end of this article. 
Also see Archer (1:532-536). 


Swhen all possible permutations are built into 
latinized, £reco-latinized, or hyper-greco- 
latinized designs, the objection to the use of 
latin squares in psychology that MeNemar (18) 
raised is obviated, (For a comment on his 
article see Kogan [14:26-27].) In tes ting 
Studies, completely counterbalanced designs 


(Vol. 23 


figures to the independent investigator, but 
they are small compared with the numbers in- 
volved in standardization studies by major 
test companies. 


8m а personal communication to the writer, 
Professor Edward E. Cureton points out the 
need for a clear discussion concerning the ap- 
plicability of analysis of variance methods to 
those cases where one criterion of classifica- 
tion involves classes of the variable rather 
than classes of the examinees, especially when 
these classes are tests such as the S-Band 
the WISC or “comparable” forms of a test. 
In part, this is the repeated-m ea s urements 
problem dealt with by Leonard S. Kogan 
(“Analysis of Variance —Repeated Measure- 
ments, *› Psychological Bulletin, XLV (1948), 
рр. 131-143) and Jack Blockandothers (“Тезі- 
ing for Ше Existence of Psychometric Pat- 
terns," Journal of Abnormal and Social Psy- 
chology, XLVI, 1951, pp. 356-359). Frederic 
M. Lord (The Standard Errors of Various 
Test Statistics When the Test Items are Sam- 
pled, Educational Testing Service, Princeton, 
New Jersey, December 1953) has examined in 
detail the case where a large number of forms 
of the same test are administered to the same 
group of examinees, each form consisting of 
a sample of items drawn randomly from a 
Common pool of items, and has derived s SUM 
large-sample standard-error formulas for this 
Situation. However, in the illustrations used 
in the present study the different tests are not 
randomly parallel, Furthermore, random 
Sampling of items might yield forms that when 1 
used with various groups of examinees consist 
ently give rather different Scores, especially 
if the number of items in each form is small. 
These forms could not be used interchange- 
ably without а transformation, even though 
they might be “comparable” in the randomly 
parallel sense, | 
“The ‘Equating’ of Non-Parallel Tests” is 
discussed by William Н. Angoff (58-54-13, Ed- 
ucational Testi Service, Princeton, New Jer- 
Sey, May 1954). 


— 
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(To Supplement Table Ш of the Article) 
100 IQ SCORES FOR THE 50 FRANDSEN-HIGGINSON SUBJECTS 


STANLEY 


APPENDIX 


S-B First, WISC Second 


WISC 
Pupil 8-8 Е5 Рирї1 
Мо. IQ IQ Sums No. 
1 132 120 252 26 
2 121 120 241 27 
3 112 117 229 28 
4 138 117 255 29 
5 125 116 241 30 
6 131 116 247 31 
Ч 117 112 229 32 
8 96 111 207 33 
9 121 110 231 34 
10 112 110 222 35 
11 85 108 193 36 
12 120 105 225 37 
13 115 105 220 38 
14 124 104 228 39 
15 112 101 213 40 
16 91 101 192 41 


42 


4 


WISC First, S-B Second 


19 
118 
118 
117 
113 
123 
114 
106 
101 
101 
112 
100 
103 

96 
96 
120 
104 


103 


IQ 
125 
115 
114 
111 
109 
109 
107 
107 
107 
107 
104 
103 
101 
101 
100 
99 
99 


Sums 


202 


201 


202 
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(To Supplement Table V of the Article) 


90 SCORES FOR THE 30 INDIVIDUALS TESTED WITH THREE FORMS 


OF AN APTITUDE TEST 


Form 

Testing Individual Sums 
Order Number A B с (А + В + С) 

1 10 54 58 182 

2 69 70 62 201 

3 69 44 60 173 

4 67 60 65 192 

5 56 57 52 165 

АВС 6 52 58 57 167 

7 45 49 53 141 

8 44 4 4 134 

9 41 50 49 140 

10 36 35 41 112 

Sums 549 + 521 + 543 = 1, 613 

Squares 31,689 + 28,027 + 29,993 4 267, 141 

11 82 64 56 202 

12 19 70 44 193 

13 10 61 46 177 

14 66 44 44 154 

15 62 46 27 135 

САВ 16 59 60 38 157 

17 58 48 33 139 

18 56 37 27 120 

19 45 47 24 116 

20 40 26 21 87 

Sums 617 + 503 + 360 = 1, 480 

Squares 39, 671 + 26,927 + 14,132 Z 230,718 

21 91 50 67 208 

22 80 31 55 166 

23 73 57 52 182 

24 70 35 53 158 

ВСА 25 66 53 44 163 

26 62 37 28 127 

27 58 22 35 115 

28 56 21 44 121 

29 50 26 46 122 

30 47 23 46 116 

Sums 653 + 355 + 470 = 1, 478 

Squares 44,319 + 14,243 + 23,140 Z 227,812 

Overall Sums 1,819 + 1,379 + 1,373 = 4,571 

Overal 
rall Squares 115,679 + 69,197 + 67,265 А 725,671 
Day l Day 2 Day 3 


Sums for Days 


1,608 1,699 


of Squares 


69,197 + 67,265 - 252,141 


1,264 


115,679 + 


(уо1. 23 4 
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Procedure for obtaining the sums of squares shown in Table V is: 


Total = == [90(252, 141) - (4571) = 19, 984. 9889 

Orders = 4(3(ав13р + (1480)? + (14188 - (4571)?} = 399. 0889 

Forms = 41; (314819) + (1379)? + (1373)?] - (4511) } = 4361. 6889 
) Days = 4 {3 [4264 + (1608)? + (1699)?] - (4571)2} = 3509. 3556 

Individuals 

Withinorders = 


35 {10(725, 671) - [(1613) + (1480)? + (1478): 1| = 9335. 2333 


Forms х days interaction within orders (latin square error)- 
4 (9[(549* + (521)? + (543)2 + (617)? + (503)? + (360)? + (653)? + (355)? + (470)? ] 
90 


1 -3 [(1613)2 + (1480)? + (1478)? ] - 3[(1819)? + (1379)? + (1373)?] - 3 [(1264) + (1608)? 


+ (1699)2] + 2(4571)? | = 6.1556 


Residual (individuals х forms interaction within orders) = 


d. (30(252 141) - 10(725, 671) ~ 3[(549)* + (521)? + (543)? + (617)? + (503)? + (360)? 
30 ü 


+ 653)2 + (355)? + (410) 1 + [(1613)? + (1480)? + (1478)2] | = 2373. 4667 


be secured more simply by subtraction, but the 
г the computations. Note also that the “Чайп square 
or orders X forms interaction and the “days” ef- 


Of course, either one of the last two terms could 
longer method provides a check upon the accuracy 0 
ie is the difference between the sum of squares f 

ct: 


2 2 2 3 2 
19649) + (521)? + (543)? + (617)? + (503) + (360)? + (653)? + (355) 


«(41081 - 3[(1613)? + (1480)? + (1418) 1 - 3[(1819) + (1379)? + (1373) ] 


+ авто } - d (81026474 (1608)? + (1699)2] - (4571)? | = 3515.5111 


- 3509. 3556 = 6.1556 


Thus th; ; of squares is simply the summation over individuals, orders, 
апа oe M es ed его. P the various order-form means corrected for.orders, forms, and 
days. 9f the squared residuals o 
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MEANS OF THE THREE FORMS, THREE ORDERS, AND THREE DAYS 


Form 


А в с 


АВС 54,90 52.10 54.30 53.77 = АВС Меап 


САВ 61.70 50. 30 36. 00 49.33 = САВ Меап 


= tJ Ü = O 


BCA Mean 


60.63 45.97 45.77 50.79 = Grand Mean 


First Day = 42.13 Second Day = 53. 60 Third Day = 56.63 


; : ints 
It is obvious from the above table that the means for Forms B and C differ extremely little (0.20 poin ), 


: UU 
while Form А is much easier. The appropriate F-test for the small difference between 45. 97 and 45 
is: 


1 
60 (2 [(1379)? + (1373)2] - (1379 + 1373*] 0.6000 
„6042 (1819) + (1373): ] - (1379 + 1373)*] _ o, 6000 


Еј 54 = 
"ове 43. 95 43. 95 


The means for Ше first a 
11.47 versus 3. 03 
following ratio: 


nd second days differ much more than those for the second and third wem 
points. То test the significance of the difference between 53. 60 and 56. 63, use 


i 
Fasa- 20021608) + (1699)2] - (1608 + 169095) _ 138.02 _ хүй 
Зиа 43.95 = 43.55 = 3. 


р» .05 
If Ше overall F-test f 


ve 
e 5 ог differences among the three order means had been significant, we could pe 
tested the discrepancy b 


etween CAB and BCA order means by 


L 
Еј27 = 6012 [(1480)2 + (1478)2 - (1480 + 1478)? | 


нет“ 
This presupposes that the аш 
345.75 


ences between tests in their residual effects are negligible. If not, the differences between the ог der 
groups will be exaggerated and 


the significance test vitiated. See Kempthorne (13:Ch. 29). 


Completely Permuted 3 x 3 Greco-Latin Square Designs 


As noted in the article there i i -lati i i ree 
levels of each of the variabl аге 36 different rows possible for the greco-latin design with th 


es, i i i in vari~ 
able and the arabic numerals i, Using the capital latin letters А, В, and C to represent the latin V 


2, and 3 to represent the greek variable, we list the 12 greco-latin 
squares that these form (the order ithi isi ri Е dealt 
with in this paper): er of rows within each Square is immaterial for the type of problem 


4 
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Square Square 
Number I п ш Number I I ш 
А1 в2 сз с2 А1 B3 
1 вз сі А9 7 Bl СЗ А2 
C2 A3 B1 АЗ в2 сі 
se OOOO OOI 
Al B3 с? C3 Al B2 
2 сз A2 Bl 8 A2 B3 Ci 
B2 сі АЗ Bl C2 АЗ 
CEREREM — = MEM EL LL LL = === 
жі с? B3 B2 c3 Al 
3 C3 нї A2 9 сі А? B3 
B2 A3 сі АЗ Bl са 
А1 C3 B2 B3 Са А1 
4 - ж cl 10 A2 B1 c3 
c2 B1 A3 cl A3 B2 
B2 А1 сз с2 вз А1 
5 ~ - "m 11 в1 А2 сз 
АВ сз ві АЗ С1 В2 
B3 A c2 сз ва А1 
6 " РА - 12 A2 сі вз 
ox өз АЗ B1 АЗ са 


NR | | ws and analyzing the results without regard to squares 
Опе op ie е 36 indie Е confounding Vith the various untested interactions. | 
15 d individuals = completely confounded, but this is P came ys perde eire 
ге; of ПО direct interest in test-comparison studies, though | Эр 1 эмт d 1 
residual eiee st in te m 13:Ch. 29) if we assign at least two subjects randomly to each of 
Бе rows Thi Ше налет the following 4. f.: 2 each for roman numerals, latin letters, and ara- 
tes ñumerals; 35 hasc ° dividuals within rows; and 72 for individuals x roman numerals in- 
тасы : for rows; 36 for ши -1)-2-2-66 that in an incompletely permuted 


itt: : dded the (36-1)(3 à 
ld не => (Grant) ог“ reco~] latin square error” (Edwards) ог “го” 


“OWS ап 


ic numerals interaction within rows” (Lindquist), giving 138 4,1. for 
» : the effects except rows, for which the ‘‘individuals within 
rows» pen error term used in tes 


€an square is appropriate. 
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When working with the 3 x 3 greco-latin square design or modifications thereof, it is петреш ы гав | 
іп mino that for a single such square there аге по d.f. for the residual, since (3x3) -1]-2 кү 
= 0. Thus, as fora 2 X 2 latin Square, each effect is completely confounded with the interaction ы. 
other effects. When only 36 individuals are tested, we are in effect using as the ‘‘within cer in 
three pooled interactions, each with 11 x 2 8.1.: 12 squares x 3 roman numerals; 12 squares x ея 
letters; and 12 squares х 3 ага с numerals. There seems to be no reason for thinking that wy и iis 
actions are not unbiased estimates of experimental error if differences among the treatments in 
residual effects are negligible. | I ikewise 

Testing 36 boys randomly assigned to each of the 36 possible rows and 36 girls assigned 11 oder 
yields a design somewhat similar to the one set forth by Archer (1:524) in his Table I. His sc ыг the 
calls for three different 4 x 4 squares for the boys and three other 4x 4 ones for the girls, bu дай 
method of analysis is identical; see his pp. 523-529, especially p. 527. In the present ај 1 Бе 
added refinement would be to divide the total sum of squares between the 72 a | varo (inter- 
components instead of two: between rows, with 35 d.f.; between sexes, with 1; and the residua M ls who 
action of rows with Sex), with 35. This is possible because each boy has a “mate” among the „е гез- 
follows exactly the same order аз he; in this sense there are 36 row means for the 72 testees. Y insi 
idual mean square would be the error term for both rows and sex, but it seems unlikely to the a u 
that this triple partitioning will in actual practice be worth the extra effort. the de- 

И 36 boys and 36 girls are tested in each of several school grades, say three different ones, 

Sign will be as shown on the following page. 1 means 

There are 3(216) - 1 = 647 d.f. ог these, 216 - 1 - 215 are for differences among the vole are 
of the 216 individuals (differences between individuals), and (216 - 1)(3 - 1) + (3-1) = 2(216) = 4 
for differences ‘“‘within individuals, ” with 

The between-individuals sum of squares may be partitioned into four independent componen: and dif- 
the following d.f, , if “rows” аге disregarded: grades, 2; sex, 1; grades x sexes interaction, 4; reco- 
ferences among individuals within the six grade-sex groups, 6(36 - 1) = 210. If the 36 different 4 г rowS 
latin rows are taken into account, the 210 d. f., would be further Subdivided into 35 for rows, 35 fo 


В т ===> ™ es inter^ 
X sex interaction, 70 for rows x grades interaction, and 70 for the residual (rows x sexes x grad 
action), 


аг” 

The 13 components of the “within” variance are secured from roman numerals, latin letters, ani 
abic numerals, their interactions (6 simple and 3 second-order) with grades and/or sex, and the 
within grade-sex groups, which has 6[(36 - 1)(3 - 1) - 2 - 2] = 396 af. inter” 

The analysis of these designs is jeopardized when significant greco-latin order differences ЧЕ at m 
because of differences among the treatments with res explains 
individuals differ from row to row). Kempthorne е апй 
: Y оп pp. 596-597 and 606-607. The design in Tables permit" 
IX of the pr two persons for each of the 36 greco-latin orders, thus 


X of the p ! ions 0 
ting significance tests of the “огдег” effect (differential residual effects) and of the three interact! 
order with grade and/or sex, 


Магсһ, 1955) 5ТАМҺЕҮ 
School 
Grade 
or Class Sex Individual I п ш 
1 А1 в2 сз 
м 
36 Bl АЗ са 
U aa 
37 Al B2 сз 
Е 
12 Bl АЗ C2 
CENE ЕС 
73 А1 в2 сз 
м 
108 в1 АЗ со 
у m C E 
109 A1 B2 C3 
E 
144 Bl АЗ C2 
MNT ^e E MEE 
145 А1 в2 сз 
м 
180 В1 АЗ са 
w —— —— J Tu <s ти 
181 А1 в2 сз 
E 
216 ВІ АЗ са 
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THE INFLUENCE ОЕ SOCIO-CULTURAL СНАК- 
ACTERISTICS ON EDUCATIONAL OPPOR- 
TUNITIES IN PUBLIC SCHOOL 
INSTRUMENTAL MUSIC" 


MELVIN L. ZACK 
Los Angeles State College 


THROUGH THE education of youth, anat- 
tempt is made, inmostcultures, to maintainstand- 
ards and foster ideals considered to be of primary 
importance. Inasmuch as equality of opportunity 
has been a cultural ideal of the United States, 
Public education has been expected not only to 
expound this ideal, but to become the agency 
‘rough which this ideal could be translated into 
veality. For the most part, both lay and profes- 
*ional opinion are in agreement with the concept 
that the abilities and interests of the child should 
be the only limitations placed upon his participa- 
tion in any school-sponsored activity. 

_ Many studies, however, have indicated that 
differences in children's backgrounds due to socio- 
economic status, color, religion, nationality 
background, or family size interfere with the at- 
tainment of equitable educational opportunities in 
Public schools, 1, 2** Most of these studies, how- 
еуег, have failed to take into account individual 
differences in the abilities and interests of chil- 
dren. The present study was designed with the 
Specific purpose of considering two sets of vari- 
ables in their influence on participation. Notonly 
Was the influence of socio-cultural va riables, 
noh às color, to be determined, but also the in- 
fluence of abilities and interests, as well as the 
interaction between these two sets of variables. 
sare an investigation concerned with many уагі- 
аро) the validity of the results is determined 

np by the adequacy of the design. It is for 
in са боп that the method of procedure is given 

9nsiderable detail. 


5 
tatement of the Problem 


ч: problem was first to determine the abil- 
Fraga, differences between participants and 
to deter iCipants in instrumental music; second, 
cen „Ле the socio-cultural differences be- 
most i rticipants and non-participants; and, ~ 
ences mportant of all, to take both sets of differ 
into account in determining whether or not 


ity 


the public schools of Kansas are providing to all 
children equal opportunities for participation in 
instrumental music. 

The need for this investigation arose from a 
consideration of the following conditions and as- 
sumptions: It has been assumed that instrumen- 
tal music courses are both elective and selective. 
They are elective in the sense that no child is re- 
quired to participate. It has been assumed that 
any child who wishes to participate may do so. 
With respect to the selective character of instru- 
mental music courses, it has been assumed that 
children with appropriate abilities and intere s ts 
tend to enter and remain in such courses, where- 
as children who lack these abilities and interests 
either fail to enter,or enter only to drop out after 
a period of participation. 

Two conditions in Kansas cast suspicion on the 
validity of these assumptions. One condition is 
that a majority of schools furnish at public ex- 
pense only а fraction of the equipment which a 
student must own in order to participate in band 
ог orchestra. This condition suggests that indi- 
vidual differences in socio-economic status may 
override individual differences in ability and in- 
terest in influencing participation. The second 
condition is that high prestige is generally as- 
sociated with membership ina school instrumental 
group. This condition suggests that individual 
differences in status due to color, nationality 
background, religious preference, or sizeoffam- 
ily may override individual differences inability 
and interest in their influence upon participation. 

The possible contradictions between these as- 
sumptions and conditions, as discussed above, 
made it necessary to take into account both socio- 
cultural characteristics as well as appropriate 
abilities and interests in studying participation 
in instrumental music classes. 

What are the abilities and interests which could 
be regarded às legitimate requirements for par - 
ticipation in the instrumental music offerings of 
the public schools? А review of the literature on 


+ i i al Ch: isti EEF, 
As Influence of Selected Socio-cultural Characteristics on Participation 
in Dis. deed Study оғ i Shed doctor ssertation, University of Kansas, 1953. 
— Musics 


Зыр : š : 
Sotnotes will be found at the end of this article 
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music education pointed to four factors: music- 
ality, iutelligence, the youngster's interest for 
music, and the support for music in the young- 
Ster's home, 3, 4,5, 6 

With the selection of these four variables as 
the abiliües and interests which could be regard- 
ed as legitimate limitations upon participation, 
and with the selection of Socio-economic status, 
color, religion, nationality background, апаѓат- 
Пу 512е аз ће Socio-cultural characteristics 
Which could not be regarded as legitimate limi- 
tations; the problem of the present study became 
а search for answers to two Specific questions: 


1. Are participants in instrumental music 
Significantly Superior with respect to 
abilities and interests aS compared to 
non-participants and as compared to 
drop-outs ? 

2. When ability and interest differences are 
taken into account, do individual differ- 
ences in status due to Socio-cultural 
Characteristics have a Significant asso- 


ciation with participation or with drop- 
out? 


Selection of the Sam le 
MU? of ше Sample 


The sample had to include youngsters who had 
reached that point in school where, if they were 
not already participating or had not already par- 
ticipated in instrumental organizations, itwas 
very unlikely that any future participation under 
high Schoolauspices would take place. This 


mi 
€ rtain the infl 
participation. For thi 
ality structure, educational Str im жура 
pational structure Were utilizeg? з. + Энн 

2 nsus 
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data did not include religious preferences of the ў 
population, it was impossible to derive ratios [01 
this characteristic. N 
Each city in Kansas was ranked in comparison 
with all other cities in its population bracket with 
respect to the size of the following, ratios: 


1. Negro population to total population. — 

2. Foreign-born white population to native 
born white population. 

3. Adult college graduates to all adults. | 

4. Adults with no years of formal schooling 
to all adults. | TT 

5. Employed males in the professionalle 
occupations to all employed males. d 

6. Employed male laborers to all employe 
males. 


The larger the ratio, the higher was thatcity'S 
rank. These six ranks were averaged and the је 
cities then were ranked on Ше basis of this w^ 
average. Eight school systems in cities with e 
highest average ranks were invited to cp 
inthis study. Two of the eight declined. ак 
School system ina high ranking бшш ich 
the same population bracket with the two W em > 
had declined, was selected, and its school О 
cials agreed to participate. а total 

This sampling procedure resulted in а гор 
sample of 960 students, of whom 538 were eig 
graders апа 422 were seniors. 


Devices for Securing Data 
Intelligence Test Information 


In order to help secure the ране n an 
Schools selected for the study it was decide 


en- 
administer the Otis Quick-Scoring Tests of M d 


: п 
tal Ability, Gamma and Beta, to seniors 4 


de 
eighth graders, respectively, in those school Эй. 
tems which desired this service. In other Е 
Ше record of any standard group шешер а 
results was utilized. Within each school ап Z- 
each grade-level, IQ's were converted 27-29 
Scores with a mean of 50 and a standard devi: 
of 10. il? 
This procedure was followed in order that ch 
dren measured by different tests of intellige es 
might be compared with each other on the Lect 
of their deviation from the mean of their 0 de- 
group. Z-scores were also needed in order to 
rive a composite score based on the means ane 
Standard deviations of the following four ы rage 
intelligence, musicality, interest for music, а 
home Support for music. 


Musicality 


Measurement of musical ability was динас 
Бу administering А Test of Musicality toall su 
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jects. Тһе items оп pages two and three of this 
test are designed to measure ‘‘the excellence of 
the ability of the individual to apprehend musical 
Structures. "В According to one authority these 
are the kinds of items which truly measure mu- 
Sical aptitude or musical ability. 9 This same 
authority maintains that two widely used tests 
іп this area do not measure musical abilities 


39 rather measure acoustical or sensory abil- 
ies, 


Interest for Music 


Though most experienced music educators 
Would not be opposed tothe proposition that a 
youngster's attitude toward music, or interest 
for music, is highly indicative of the degree of 
use to which he puts his musical ability, only 
One test which measured this important predic- 
tive factor could be found. This was the first 
Section, 1.е., page one, of A Test of Musicality. 

Because norms for this section of the test, as 
Well as for the musicality section, are ргезепі- 
ed both by grade levels and by sex, it was пес- 
essary first to convert all raw scores to the 
Percentile ranks appropriate to the grade place- 
ment and sex of the youngsters taking the tests 
and then to convert these percentile ranks to 2- 
Scores. This procedure made it possible to 
attain comparability of boys’ and girls’ scores 
ав well as comparability of eighth graders’ and 
Seniors’ scores, It also was needed for the com- 
Розе scores mentioned previously. 


Home Support for Music 


Hardly any educator would deny that a power- 
ful influence 15 exerted by the attitudes of par- 
ents upon the behavior of their children. Inspite 
Of this fact, there was found no instrument which 
attempted to measure parental attitudes toward 
аа For this reason an attempt was made to 
mL Such an instrument. Extreme care 
ые to insure that the questionnaire mea- 
Consi What it purported to measure, and did 50 
enc oistently, Two different groups of experi - 


n : h | 
ced music educators examined each item inan 
effort to 


Power, 
determi 


assess its validity and discriminating 
Statistical estimates of validity were 
dichoto ned by contrasting scores with teachers’ 
t-tests mous categorizations of the homẹs. All 
liability оте Significant at the . 01 level. The re- 
dividi ty 9f the questionnaire was determine d by 
Scorj ng it into two roughly equivalent halves, 
ficient, each half, and then computing the coef- 
о зе 9f correlation between Ше scores onthese 
had ections, Inasmuch as four sets of norms 
diffe, en necessary to ‘handle both sexandgrade 
ences, the correlations were performed on 
each „domly selected groups, one from within 
norm group. The coefficients ranged from 
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.80 10.89, and all were significant at the . 01 
level. 


Socio-cultural Characteristics 


Information concerning the occupation of the 
head of the household, color, religion, nation - 
ality background, number of children inthe home, 
and music courses taken was obtained by comple- 
tion of a questionnaire by the subjects. Wherever 
school records permitted it, the student report 
was validated against school data. 

The occupational scale developed by Warner, 
Meeker, and Eells was utilized as a measure of 
Socio-economic status. Protestantsects were 
categorized in accordance with several articles 
ina recent encyclopedia of religion. ll wation- 
ality background was categorized for white sub- 
jects only. Grandparents' place of birth was the 
arbitrary means employed to place a white sub- 
ject in “native”, Anglo-Saxon, Latin, or Slavic 
categories. 


Normality of Data 


In order to determine whether the intelligence 
scores, musicality Z-scores, interestfor music 
scores, and home support Z-scores departed 
from normality, chi-square tests of significance 
were applied to. these distributions. Since the as- 
sumption that these four variables are distributed 
normally in a school population had been made, it 
was decided to transform into normalized Т- 
scores those Z-scores which did depart signifi- 
cantly from normality. This procedure was ne~ 
cessitated by subsequent t-tests which are based 
on such an assumption. 


2- 
7- 


Composite Scores 


For each individual in the study it seemed ad- 
vantageous to obtain a single composite score 
representing the individual's intelligence, music- 
ality, interest for music, and home support for 
music. In deriving a composite score, consider- 
ation was given first to discriminant function 
weightings, 1.е., weightings for each of these 
four variables which would maximize the differ- 
ences between participants and non-participants. 
However, the use of composite scores based on 
discriminant function weightings, in further sta- 
tistical comparisons which hold constant com- 
posite score, would bias the outcomes of such 
comparisons and, therefore, was rejected. The 
arithmetic mean of each individual's four T- 
scores was the composite score utilized. ^^ 

Although each variable could have been con- 
sidered separately, the interdependence of these 
four variables in discriminating between partic- 
ipants and non-participants, as shown by prior 
research, made more valid the use of the com- 
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posite score. The awkwardness of simultan- 
eously holding constant four different variables 
was another reason for using the compos ite. 


Statistical Tools Used 


At each grade level in each communi ty t- 
tests were calculated to test the hypothesis that 
there was no difference between participants 
and non-participants with regard to means on 
composite scores. The assumption which had 
to be satisfied before the t-test could be applied 
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Negro students in the study (N-24) with white 
students of equal composite score, of equalsocio- 
economic status, and of the same grade level. | 
Chi-square was Ше statistical tool applied to this 
equated group to test the hypothesis thatthere was 
no difference in the proportions of Negro and white 
participants. 

In some schools, t-tests between the means of 
composite scores of participants and non-partici- 
pants resulted in findings of no significant differ 
ences between these groups. It was not neces 7 
Sary, then, to hold constant composite scores 


was that there was no difference between stand- 
ard deviations of the two groups. This assump- 
tion of homogeneity of variances was tested by 
application of the F-test. In the event that this 
assumption was not satisfied, the Behrens- 
Fisher or d-test was used in place of the t-test. 

At each grade level the procedure explained 
above was utilized also ina comparison between 
participants and drop-outs with regard to means 
on composite scores. 

Analysis of variance and covariance is the 
technique usually used in cases involving com- 
parisons between groups on one variable, e.g., 
Socio-economic status, holding another variable, 
9.8., composite score, constant. Because dis- 
tributions of socio-economic status, family size, 
color, religion, and nationality background could 
not satisfy the assumptions of normality andcon- 
tinuity, analysis of variance and covariance could 
not be utilized. Instead, analysis of variation by 
the method of ranks was used. 12 This technique 
15 applicable to data of a qualitative character 
and to data which are not normally distribute d. 

Inasmuch as this statistical tool, analysis of 
variation by the method of ranks, is more sensi- 
tive when individual cell entries are numerically 
large, pooling of schools was utilized, 


when determining whether or not these two groups 
differed significantly with regard to religion; 
color, socio-economic status, family size,or са 
Попа Шу background. In these situations Ше $ 
tistical tool applied was the significance of the 
difference between percentages. 


Findings 


Reference to Table II shows that in eleven = 
the fifteen comparisons made, participants 2 
superior to non-participants with respect to 70 
posite score at the . 01 level of significance. two 
comparison was significant at the . 02 level; 1: 
comparisons were significant at the . 05 leve 2 
one comparison failed to reach the . 05 level о 
Significance. ite 

It was decided to hold constant compos! rid 
Score, representing interests and abilities, ! 
the eleven comparisons significant at the - 
level and in the comparison significant at ретін 
level when determining the association Lager си 
various status characteristics and pesos. of 
іп instrumental music activities. Тһе геѕи e 
the application of analysis of variation by th rted 
method of ranks to these twelve groups, герог о 
in Table Ш, indicate that, with composite Ны ie 
held constant, there was found no significan һе 
Sociation between participation and each of t Э 
following characteristics: socio-economic Еи i 
religion, family size, and nationality ans 

In dealing with the three comparisons м an 
failed to reach the . 02 level of significance Wi 
respect to differences between participants шон 
non-participants іп composite score, compos? 
Score was not held constant when determining of 
the association between participation and ёас 2 
Ше four characteristics mentioned above. Ын, 
results of the application of Ше significance 0! їй 
the difference between percentages to the po^ 
these three schools is reported in Table 1 " 
These results show that for the two senior group 
there was found no Significant association ђе“ да 
tween participation and the four status characte) 
istics. In the eighth grade group, however, th 
association between socio-economic status ап! 

Я participation as well as one of the comparisons 
dealing with the association between nationality 
background and participation were significantat 


Table I illustrates the applicat; 
iati Dplicat : 
of variation by the methog of та. ра PE 
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TABLE I 


RANKS OF PERCENTAGE OF PARTICIPATION IN INSTRUMENTAL 
MUSIC FOR SPECIFIED LEVELS OF COMPOSITE SCORE AND 
OF SOCIO-ECONOMIC STATUS AMONG EIGHTH GRADERS 
IN TOWNS A, C, AND D 


ae OT 
ks based on percentage of participation in instrumental 


Composite Ran 


score music by socio-economic status 

intervals =U 
65+ 5 5 1.5 5 5 1.5 5 
55-64 Ч 2 3 5 4.5 1 4.5 
45-54 7 4 1 2 5.5 5.5 3 
35-44 5 5 2 1 5 5 5 
ипаег 35 4 4 4 4 4 4 4 
Sum of ranks 28 20 11.5 17 24 17 21.5 
Mean rank 5.6 4 2,8 3,4 4.8 3.4 4.3 
Deviation 1.6 0.0 -1.7 -.6 .8 =, 48 


Theoretical mean = 1/2(р+1) = 4.0 
Sum of deviations squared - 6. 9 


2 Оп (уа 
Мое — Жш 


хт = 7.4 
а. Е. =6 .30» P».20 


ала cc асаан. 
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TABLE II 


COMPARISONS BETWEEN PARTICIPANTS AND NON-PARTICIPANTS 
WITH RESPECT TO COMPOSITE SCORES 


School d. f. F Mean of Mean of non- t 
participants participants 
Eighth Grade 
ANo.1 24,46 1.28 53. 64 48. 72 3. 92жж* 
А №.2 11,48 1.33 55. 58 48.51 3. 67*** 
в 29, 64 1.06 55.07 47.98 4. 83*** 
с 115,23 1.98* 54.25 41.68 5.8} 
р 38,15 1.13 57.38 41.46 5.55*** 
E 22,12 2.28 57.31 45. 61 6. 62*** 
F 24,2 1.16 62. 67 50.4 2.64** 
G 22,5 1.8 58.52 53.5 2.39* 
Twelfth Grade 
A 83,16 1.61 55. 88 48. 86 3.88*** 
B 13,26 1.16 56. 79 48.59 3.12*** 
c 9,82 1.32 55.7 49.59 2. 79*** 
D 51,4 3.99 53.8 46. 88 2.22* 
E 18,23 1.04 55. 96 45.32 6.32*** 
F 28,3 1.88 55.5 47.93 1.95 
в 14,33 1,32 55.53 50.32 3.19*** 


* 
жж 
жжж 


Significant at the , 05 level 
Significant at the . 02 level 
Significant at the . 01 level 


# білсе (е assumption of homogeneity of variances was not met, the Behrens- 
The obtai test was used to test the Significance of the difference in means. 
ined value (4-5, 8) is significant at the . 01 level, 
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TABLE III 


PATION AND VARIOUS STATUS 
ANALYSES OF THE ASSOCIATION BETWEEN PARTICI 
CHARACTERISTICS WITH ABILITIES AND INTERESTS HELD CONSTANT 


/————  —ODMÓ = === = === 


Comparison d.i. xr Probability 
Comparison 
Socio-economic status 

(seniors in towns A and C) 4 200 а 
Socio-economic status 0»P».30 
(seniors in towns B, E, and G) 4 nés ш 
Socio-economic status 20 
(eighth graders in towns A, C, and D)* 6 TR лада 
Socio-economic status .710»P».50 
(eighth graders in towns B, E, and F) 6 +29 

Family size 3. .50»Р».30 
(seniors in towns А, B, C, Е, and С i - 

plus all eighth graders except іп town G) 

Religion 5 8.29 .20>Р>.10 
(seniors in towns А, B, C, Е, and С 

plus all eighth graders except in town 6) 

Nationality background 3 1.16 .80>P>.70 


(seniors in towns A, B, C, E, andG 


plus all eighth graders except in town G) 


* A detailed presentation of analysis of variation py the method of ranks, dealing with 
this comparison, is reported in Table I. 


== a ee 
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the .02 level. 
In eight of the fifteen sample schools there 
were found to be Negro youngsters. Inorder 
to determine whether or not these twenty-four 
Negroes were participating in instrumental 
music to as great an extent as white youngsters 
of equalabilities and interests, it was necessary 
to select from the eight sample schools con- 
cerned those white students whose composite 
Scores were of equal value to some Negro stu - 
dent. In order to remove the influence of socio- 
economic status upon the outcome of a test of 
Significance, it was decided that equivalent socio- 
*conomic status would be another criterion for 
equating the groups. Chi-square was the statis- 
tical technique used to ascertain whether or not 
there was a significant difference between the 
proportion of participants to non-participants 
among the Negro youngsters and this proportion 
in a matched group of ninety-five white young - 
sters. The data and test of significance are re- 
ported in Table V. Тһе results indicate that 
there was no significant association between 
color and participation in instrumental music 
where grade level, composite Score, andsocio- 
economic status were controlled. 

In the comparisons dealing with differences in 
mean composite score between eighth grade par- 
ticipants and eighth grade drop-outs as wellas 
mean composite score differences between sen- 
ior participants and senior drop-outs, the ob- 
tained values of t were Significant at the . 01 level. 
In each case, participants were Superior to drop- 
outs with respect to the composite of abilities 
апа interests, These findings indicated that com- 
posite score would have to be controlled in allof 
the comparisons involvin 
outs, comparisons deali 
between drop-out and ea 


nationality bac 
of these compari У background, The results 


out. Inspection of the data 
Suggest that color 


ticipants in twelve of the еды from non-par- 
differentiate participants from drop ts i 
“outs inall 


Schools. Though this finding constitutes a nec- 
essary step in the process of determining wheth- 
er or not the public schools of Kansas are pror Р 
viding to all children equal opportunities for par 
ticipation in instrumental music classes, itdoes 
not, taken by itself, provide an answer to this 
problem. t 

The purpose of ascertaining whether or ща 4 
participants differed significantly fron: non-par 
ticipants and from drop-outs with regard to d 
telligence, musicality, interest for music, an 
home support for music, those и миш ШЕ. 
of youngsters which may be regarded ав ща 
able limitations upon participation, was to Ч 
ize valid procedures in attacking Ше crucia Sole 
question in this study. This question was 45 io 
lows: do individual differences in status due n- 
color, religion, socio-economic status, Sean и 
ality background, or family size have a sign " 
cant association with participation or with droy 
out? " 

In schools in which participants did not differ 
significantly from non-participants with Эр 
to Ше composite of avilities and interests, arde 
manner of answering this crucial question W 


: ing ге- 
ascertain whether or not children of ее di 
ligious preference, differing socio-econom 


el, differing color, differing nationality etm 
ground, and differing size of family were iid 
Sented in instrumental music organizations = 
proportion to their numbers in Ше total € 
enrollment. This simple procedure coula Шо 
be used in schools in which participants ve = 
а significant superiority in abilities and in ts. In 
ests over non-participants or over drop-ouls. 
these latter cases, it was necessary to cons 
different levels of ability and interest, i. €- > 
hold constant the composite of interests а nd 
ites, in ascertaining whether or not children 
varying socio-cultural characteristics we r tions 
Tepresented in instrumenta1 music organiza nt 
in proportion to their numbers in the differe 
ability-interest levels. 4 ith 
The former technique was used in Mee bm 
three of the Sample schools; the latter techn > 
with twelve of the sample schools. With ve ћ 
серНоп of опе eighth grade group, for iae the 
judgment must be suspended, the answers 
crucial question in this study were the a » 
Individual differences in status due to color: 


ідег 


" м : ack^ 
Socio-economic level, religion, nationality D 


о 
ground, and size of family were found to le 
Significant association with participation in ы 
Strumental music, Inall Schools, individ ЦИ. 
differences in these socio-cultural character?" 
tics were found to have no significant pcs n 
tion with drop-out from instrumental organiz: 
tions. dent 
These findings are encouraging to the pw 
of human affairs in that the evidence reveale 
that an elective and selective area of public 
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TABLE IV 


ANALYSES OF THE ASSOCIATION BETWEEN PARTICIPATION AND VARIOUS 
STATUS CHARACTERISTICS IN SCHOOLS IN WHICH PARTICIPANTS AND 
NON-PARTICIPANTS DID NOT DIFFER IN ABILITIES AND INTERESTS 


Comparison х Probability 
Socio-economic status (seniors) 1.14 . 08 
Socio-economic status (eighth graders) 2.34 .02 
Family size (seniors) .32 „15 
Family size (eighth graders) .48 .63 
Religion (seniors) .82 . 41 
Religion (eighth graders) .54 .59 
Nationality background (seniors) 14 .89 
Nationality background (eighth graders) 
Native vs. Anglo-Saxon 2.33 .02 
Native vs. Slavic 1.39 .16 
1.12 .26 


Slavic vs. Anglo-Saxon 
ge ЕЕ C 


TABLE У 


PARTICIPANTS AND NON-PARTICIPANTS WITHIN А GROUP OF WHITE AND NEGRO 
YOUNGSTERS EQUATED FOR ABILITIES, INTERESTS, SOCIO- ECONOMIC 
STATUS, AND GRADE LEVEL 


Color Participants Non-participants Totals 

Negro 7 (a) 15 (b) 22* 

White 14 (c) 81 (d) 95* 
Totals 21 96 ит 


(ad - bc) (ажрнстд) 


* 07 (a+b)(e+d)(a+c)(b+d) 
xà = 3.54 
4.1.-1 110>Р>.05 


c 
* 2 : : -al white pupils, each of whom could be matched 
Altho s possible to find severa t à эн 
to и а pupil, it was impossible to find any White students who could be 


a match for two of the Negro youngsters. 
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TABLE VI 


ANALYSES OF THE ASSOCIATION BETWEEN DROP-OUT AND VARIOUS STATUS 
CHARACTERISTICS WITH ABILITIES AND INTERESTS HELD CONSTANT 


Comparison d. f. & 5 Probability 

Socio-economic status (all seniors) 5 3.68 .70>Р>».50 
Socio-economic status 

(eighth graders in towns B, D, andG) 4 5.8 .30»Р».20 
Socio-economic status 

(eighth graders in towns A,C,E,andF) 4 4.4 .50>Р>.30 
Family size (all eighth graders) 4 1.77 .80>Р>.70 
Family size (all seniors) 3 .99 -90>P>.80 
Religion 

(all eighth graders plus all seniors) 4 4.31 .50>Ру.30 
Nationality background 

(all eighth graders) 2 1.31 .70»P».50 
Nationality 


background Ы 
(ап Seniors) ы 


2 1.36 .70>Р>.50 


^ 
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School instruction was providing children with 
equal opportunities for participation. These re- 
Sults are in diametric contradiction to much of 
the present published data regarding student par- 
ticipation in public schoolactivities. This fact 
Suggests that additional checks of the validity of 
this study should be made. 

Тһе interests and abilities selected as appro- 
Priate to participation in musical activities may 
not be the best choices possible. Kansas com- 
munities may be too homogeneous to test ade- 
quately the issues raised in this study. Since the 
Statistical technique of analysis of variation b y 
the method of ranks is more sensitive to large 
Individual cell entries, a larger sampling might 

е made, 

The contradiction between the results of this 
Study and much past research is due alsoto the 
Philosophical basis and methodology ofthe pres- 
ent study. Past research has failed, for the most 
Part, to take into account individual differences іп 
the abilities and interests of children for the pub- 
lic school activity being investigated. Having 
made such an omission, differences in Socio- 
economic status or insome other socio-cultural 
Characteristic between participants and поп-раг- 
ticipants, when discovered, have been regarded 
aS proof of unequal opportunities for par tic ipa- 
tion. This is the same, it seems, as stating 
that equality of opportunity in a democracy is the 
equivalent of identical participation. 

‚ According to the philosophical position taken 
i the present study, such a viewpoint is invalid. 
n this study, equality of opportunity was inter- 
Preted to mean the full development bythe school 
т each individual's abilities and interests with- 
2s regard to color, religion, and similar socio- 

ultural characteristics. 
"E Analysis of variation by the method of ranks 
bel Well suited to the central problem of this 
sible | By use of this statistical tool, itwas pos- 
щета ю determine Ше rate or percentage of par- 
аа in each of several different levels of 
а апа abilities for each of several cate- 
о чы of socio-economic status, religion, and 
this 5 Characteristics, With data organize d іп 
er Kota Shion, it was possible to determine wheth- 
tial ch, 6546 and abilities were the more influen 
in їгс acteristics associated with participation 
хат 1С or whether socio-economic status, for 

It 8, was more influential. | | 

Š conceivable that the philosophical posi- 
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tion and statistical methodology employed in the 
present study might prove to be useful in areas 
other than participation in instrumental music. 
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SIMULTANEOUS ABSOLUTE SCALING FOR 
SEVERAL GROUPS" 


| W. А. GIBSON 
Center for Advanced Study in the Behavioral Sciences 
Stanford, California 


РА THE METHOD of absolute scaling was 
Н veloped some years ago (ref. 1) as one solu- 
lon to the problem of a mental unit of measure- 
Ub The method defines the psychological 
көзде of measurement to be such that the distri- 
utions of ability for several age groups onthat 
Scale are normal іп form. A check on whether 
B а definition is possible for a given set of 
in са made available, and а way of determin- 
wo" parameters of the resulting scale is pro- 
даа The present paper is concerned with an 
ernative way of determining these same par- 
ameters, 
” е logic of absolute scaling is not difficult. 
dist Scale of measurement exists such that the 
ver ributions for several age groups on it are 
et then the location of any point on that 
its е can be expressed very simply in terms of 
p. On in any one of these distributions. 
zr € point Xi have normal deviates 211 inage 
"P 1, 212 іл аре group 2, etc. Then 


`S Ма + байн, (1) 


mut Mr and oy are the mean and standard de- 
n mds of the distribution for age group г, and 
em he number of age groups in a given prob- 
tion If the point Xj represents the scale posi- 
Pr ie а raw score, then its Zir are the norm- 
ван Standard scores for that raw score in 
values the age groups. If Xi is the difficulty 
балына а test item, then its Zir are the normal 
Succe eS associated with the proportions of the 
ute ЗЕ ре age groups who fail that item. Abso- 
ile те can be applied either to the percent- 
E S of raw scores or to item difficulty data. 
CN Ue tions (1) define a straight line in an 
the pens Which Zil, Zi2,..., Zir,... Ú 2іпаге 
The eg, = Шаг coordinates of a point on the line. 
нен ona then state, in effect, that the n- 
Scores ional graph of the normalized standard 
must bs normal deviates for the n age groups 
Ше plott linear. Being empirically determine 3 
ше 0 ей points will not lie exactly ina straig 
abso] "t they must come close to it before 2n 
Ше Scale сап be fitted with negligible error. 


и гезе 
of thee’ Grant М-503 (С) from the Uni 
University of North Carolinas 


Е University of 5 
arch was supported іп part died States Public Health Service to the Psychometric Laboratory 


The original absolute scaling method (ref. 1) 
involves the plots of the normal deviates for all 
pairs of adjacent age groups. These plots are 
used to determine the parameters of the abso- 
lute scale. Equations (1) are solved explicitly 
for 211 іп terms of 212 to give 


02 M2-M1 


Zii-— 212 + (2) 
01 01 


A straight line is fitted to the plotted points 
on the 711 - 712 graph, and its equationis writ- 
ten in slope-intercept form. Тһе slope then 
represents the ratio of the two standard devia- 
tions, while the intercept gives the difference 
between the two means in units ої о]. The pro- 
cess then shifts to the 712 - 213 plot, then to 
the 713 - 214 plot, and so on up to the Zi(n-1) 
-Zin plot. Thus the scale is constructed step- 
by-step, each new fitted line providing the mean 
and standard deviation for one more age group. 
The process requires n-1 line fittings. The 
method to be described here yields the param- 
eters for the n age groups simultaneously by fit- 
ting the line only once in n-space. А disadvant- 
age of the present method is that it is somewhat 
wasteful of the available data, but this can be 
overcome, in large measure, in ways that will 
be discussed later. | 

For Ше purpose of fitting a line in п-врасе 
it is convenient to borrow some concepts from 
the n-dimensional vector geometry that has 
been so useful in multiple-factor analysis 
(ret. 2). There the factor loadings of tests are 
the projections of vectors on reference axes. 
The vectors of factor analysis all radiate out 
from a common point—the vertex of the vector 
configuration, and the vertex happens to be 10- 
cated at the origin of the coordinate system. In 
the present context each raw score or testitem 
may be represented by a vector, the coordin- 
ates of whose terminus are the corresponding 
Zir- Before we can talk about the vector con- 
figuration, however, we must locate its vertex 
in some relevant way. The configuration will 
differ, depending upon where the vectors orig- 
inate, even though the vector terminiare fixed. 


Illinois Research Board Grárt and in part by 
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A natusal answer here is to locate the vertex 
on the best-fitting line. Inthis way the vector 
configuration approaches unidimensionality. 

Ап established principle of curve fitting in 
two dimensions is that the best-fitting straight 
line for a set of points shall pass through the 
centroid of those points. This principleis read- 
ily generalized to n-space. The vertex of the 
vector configuration can therefore be made a 
point on the best-fitting line by placing it at the 
centroid of the vector termini. It is not diffi- 
cult to show that an additional property of this 
position of the vertex is that it minimizes the 
Sum of the squared vector lengths. 

With the vertex and the centroid identical, it 
is convenient for subsequent computations to 
translate the origin of the coordinate system in- 
to coincidence with the very same point. Then 
the best-fitting line will pass through the origin. 
It is only necessary to locate one more pointon 
that line in order to write its equation, Again 
it is convenient to borrow some concepts from 
factor analysis. If the configuration is fairly 
long and narrow, then most of the vectors will 
lie in only two octants of the n-space—the one 
in which the vector projections on all axes are 
positive, and the one in which all such projec- 
tions are negative. It is an easy matter to re- 
verse the direction of those vectors that have 
nothing but negative coordinates. Thenthe first 
octant will contain all or nearly all of the vec- 
tors. The centroid of their termini can be tak- 
еп аз the second point оп the best-fitting line. 

The data in Table I can be used to illustrate 


the computing routine Table I i 
b contains the 
normal deviates corres - 


ould be determined for 


ultaneous]: 
ould use only the ас but such a 


Sible. Inthis wa ble entries as pos- 
y most р 
сап be used in the fitting + 
гэгч block Separately, Then, пу 
ра Fepeated application of the = hat amounts 
Иж. Ма овна сап Бе Combined concepts, 
ng ед line for the whol to give a 
deviates, е table of normal 
Figure 1 shows the 
вгарһ 
іш Sabin L The fact that this a columns 1 апа 2 
Pproximately linear іш di the other plots 
lute scale can be fitteg to the tes that an abso- 


TeSent data. Also 


(Vol. 23 


shown in Figure 1 are the results of the fitting 
procedure that is being used. The two parallel 
slanted lines indicate that the points between 
them are represented in one of the blocks. Here 
itis block А. The other constructions will be 3 
explained as they are made possible by the cal 
culations. 

At the bottom of Table I are recorded the 
sums and means ої the column entries within 
the three rectangular sections. The col umn 
means, mr, for each block are the coordinates 
of the centroid of the points represented in tha 
block. а 

In Figure 1 the dotted lines labeled aji €i 
aj2 have been made to intersect in the centro! 4 
of the points represented in block A. Тһе рго 
jections of all points on axes translated to d 
new position are obtained simply by subtracti 
the mean of each column from every entry in 
the column. That is, 


(3) 


n Table 
th one 


air = Zir - mr. 


The resulting air for block A are shown 1n 
IL From that table it is apparent that, WI о 
exception, the projections of all points on tive. 
new axes are either all positive or all nega t to 

In this translation of axes it is convener ин. 
carry along certain points not represented ir po^ 
in a particular block, and to determine their P. 
Sition in the new coordinate system. Theo а 
the points whose coordinates on some of дес” 
axes represented in Ше block are apex ints 
tion 1 of Table III shows the ajr for such Fates 
on the new axes of Table П. These coor й the 
are obtained by means of equation (3) ВО rable 
corresponding entries in columns 1-5 of 
1. of 

It is desirable to relate two other sets the 
points to the same new axes. These are ean 
points having Zir of zero and of 1--the ipution 
Mr, and the point (Mr + ог) in the distri ple 
of ability for each age group. Imagine ы” st the 
аз being extended at the bottom so as to lumns- 
Zir for these points in the appropriate C° ш 
Then the coordinates of these points with көп е 
to Ше new axes can be obtained in eR ні in 
Same way as were the entries in Table П own 
Section 1 of Table Ш. The results are sh 
in section 1 of Table IV. In symbols, 
a 


aMr=0-mr=-mr, 
and 


(5) 


Agp-1-mr. 
e 
At the bottom of Tables П, Ш, and IV 27 
Shown summary checks for the air contal ossi 
in those tables. These checks are made P ай 
ble by summing equation (3) over the 4 V4 
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ТАВЬЕ 1 


NORMAL DEVIATES FOR РМА PERCEPTION TEST 


Age Group 


5 6 " 8 9 10 


Age Range 
9-9.5 9.5-10 10-10.5 10.5-11 11-11.5 11.5-12 
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TABLE II 


TRANSLATED COORDINATES FOR SECTION A OF TABLE I 


Age Group 
3 4 5 
65 1.91 1. 67 1. 61 
. 45 1.57 1.38 1.33 
18 1.20 1.10 1. 02 


(уо1. 23 
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TABLE V 


ABSOLUTE SCALE VALUES FOR RAW SCORES 


Raw Scale Raw Scale 
Score Value Score Value 
43 4.00 21 1.15 
41 3.85 19 . 84 
39 3. 63 17 ‚54 
37 3.46 15 .21 
35 3.33 13 - .12 
33 3.04 11 -.41 
31 2.15 9 - .63 
29 2.50 1 - .85 
27 2. 09 5 -1.04 
25 1.79 3 -1.24 
23 1.46 1 -1.88 


TABLE VI 


ABSOLUTE SCALE VALUES FOR M AND 0 


Age Age 

Gi 2.07 1.18 
10 11.5 - 12 1 96 ЭЭ 
9 11 11.5 

= 1.16 1.11 
8 10.5 - 11 

a 1.58 1.05 
1 10 10.5 
6 9.5 - 10 1.34 1.07 
5 9 - 95 1.07 1.18 
| TTE ‚65 1.11 
$ P e Ed ‚39 1.06 
2 188 11 1.06 

т - 15 00 1.00 


= 


| 
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of air that are involved for any value of r. Thus 


q а 
Zair = Ē Zir - qmr. (6) 


For example, the sum of the entries in column 
1 of section 1 in Table IV is .56, and by equa- 
tion (6) this should agree with the check value 
(1+0 -2-.22)if the ajr have been correctly cal- 
culated. The sum row in Table II is the sum of 
rows (15), (24), and (5-) in that table, the lat- 
ter two rows being used in subsequent calcula- 
tions. 

With all points referred to new axes whose 
intersection defines one point on the best-fitting 
line, the next task is to locate a second pointon 
that line. At the bottom of Table II are shown 
the sums of the positive (£+) and of the negative 
(Z-) coordinates for block A. Тһе point (15) is 
excluded from the formation of these sums. The 
absolute sums for these two rows appear in the 
row marked (21). These absolute sums are 
proportional to the coordinates of the point that 
is wanted. That point is the centroid of the ter- 
mini of all vectors that lie in the first octant 
after the reflection of those vectors ha ving all 
negative coordinates. In the present example, 
6 vectors alread lie in the first octant, while 6 
others can be put there by mere reversal of 
their direction. Row (211) gives the sums of the 
Coordinates of these 12 vector termini on each 
of the coordinate axes. Division of these sums 
by 12 would give the coordinates of the centroid 
being sought. Justas they stand, however, these 
Sums Constitute direction numbers for the best- 
have been so used to deter- 
They may be inter- 


the line vector, 
The two ends of the line v 


a : 
tions of the үес: те proportional to the projec- 


-fitting line. The 
Vector. Since the Scale of = length of the line 


trix A, column Vis А 
ma 
У, and row (20) s апарса column vector 
vector B, then the matrix Product. а column 
> 
TM а) 
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gives Ше scalar products of all vectors in block 
A with the line vector. In ordinary a lgebra, 

the i-th scalar product is the i-th entry in со1- 

umn V and is give by 


Vi = 3i1b] + aj2bg +....+ajpby +.... +ainbn, (8) 


where by is the r-th entry in row (211). Sum- 
ming over i in equation (8) gives 


Zvi = Ша + Бабата +... + Бура, ++ 
і і 


Баш. (9) 
1 


This provides a summational check оп Ше - 
culation of column V. The quantity on the жер 
in equation (9) is shown іп Ше (Ch. ) position the 
the bottom of column V. Its agreement with 
sum of column V constitutes the check. йв 
If point i lies оп Ше best-fitting line and v 
projection on any axis г is known, the SC Ба 
product of its vector with the line vector ет 
determined. Suppose that by has to be мн?” 
plied by a quantity cj іп order to give air: 
for all axes, including г, 


.,8in 


(10) 


ail 7Cib1,aj2-cjb2,...., ајр = Србу, · +: 
= Cjbn- 
uct 
From equations (8) and (10) the scalar prod 
of vector i with the line vector is 


(11) 


n 

2 

2 2 sh? 201: D Dr 

Vj = Cib] +.... сі +... жод = Ci 2, T 


Р 5 
The quantity cj is defined by equation (10) 2: 


12) 
сүх Bir, 
br 
50 that equation (11) becomes 
ч 2 
Z bp 13) 
vj =Г=1 Bir. ( 
br 
a 2 
Z br 4 
Let k, = rcl рм 
br 
15) 
Then Vi = krair . ( 


i 
The quantity kr is constant for all values of 
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ene quantity Yb? is shown at the right of row 
T in Table II. In row (kr) at the bottom of 
Нала П are recorded Ше values of kr. Іп sec- 
sult of Tables Ш and IV are recorded the re- 
b i of multiplying the projections in section 1 
2% е appropriate kr. At the bottom of section 
Si Tables Ш and IV are shown the usual sum- 
iet dpi based upon the summation 01 

i ion (15) over the а values of ajr that are 

volved for any value of r. Thus, 


Ч а 
Буј = kr Z аш. (16) 


ass entries in section 2 of Tables III and IV 
res estimates of the scalar products of the cor- 
on bonding vectors with the line vector, based 
the 5s Me Up that all of the points lie on 
is rid fitting line. Where only one estimate 
umn va ble, it has been recopied into the col- 
or mene V in Tables Ш апа IV. When two 
point mar dO are available for a given 
umn a "г Sum is recorded in the sum col- 
Summa their average is recorded in column V. 
regu 3 checks аге not possible here, but ће 
especially © ession of the entries in column V, 
an nil between Tables II and III, provides 
in colum ional check, and of course each entry 
nitude ini V of Table Ш must be similar inmag- 
age, the quantities of which it is the aver- 
Ts = ntries іп column V of Tables II, Ш, 
tion ог m à fitted unidimensional representa- 
T calc Ч first five columns of Table I. Simi- 
Table ү ulations based on sections B and C of 
in one cove two other fitted dimensions, Hence 
mensio Omputational cycle the original ten di- 
turn Ачы are reduced to three. These three in 
tition di ын collapsed into one by a single гере- 
essent, е Same kind of calculations, Nothing 
апа so th, У new is involved in such calculations, 
absolute еу will not be shown here. The final 
origin è Scale is shown in Tables V and VI. The 
Justeq аб wee of measurement have been а4- 
а standa hat age group 1 has a mean of 0 and 
tions in Td deviation of 1. The standard devia~ 
ша, п Table VI were obtained from the form- 
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gr = (Mr + ог) - Mr, (17) 


applied to the adjusted scale. 

The computing procedures that have been de- 
scribed here are independent of the graphs and 
could be completed without them. It is never- 
theless a valuable addition to have some of the 
graphs (for all pairs of adjacent columns, for 
example)as visual checks. In the first place, 
the graphs indicate whether an absolute scale is 
possible at all. If deviations from linearity are 
serious and cannot be traced to plotting or cler- 
ical errors, then the computing process need 
never begin. In making the constructions it is 
a frequent experience to find something wrong 
with them on all of the graphs involving a par- 
ticular column of normaldeviates. This usually 
indicates that a computing error has occurred 
somewhere in that column. Furthermore, the 
nature of the graphicaldisparity usually suggests 
the kind of computing error that has been made. 
The incorrect translation of axes is indicated by 
the crossing of the new axes away from the mid- 
dle of the configuration, and errors in comput- 
ing the direction numbers show up in the tilt of 
the fitted lines. Computing errors that are ас- 
tually very Small can be detected from the graphs. 
Finally, the fit of the lines is a visual index 
of how well the theoretical scale of measure- 
ment is reflected in empirical fact. 
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АХ EXPERIMENTAL E 


VALUATION OF TWO 


METHODS OF TEACHING MUSIC IN THE 
FOURTH AND FIFTH GRADES 


CARL B. NELSON 
University of Minnesota 


by са МАМУ judgments hive been made 
of instrume ucators as to the comparative value 
music trai ntal music training versus vocal 
has been е very little systematic research 
Obtain des in classroom experimentation to 
he pir idence of the effects of these judgments. 
objectives ам of this experiment was to obtain 
9f à course {а with respect to the relative worth 
music eee study which utilized not only vocal 
struction, ^ but also instrumental music іп- 
кетесіз aim of many music teachers and 
It is of si 5 has been ‘‘music for every child". 
ucted Ty paynu as to note that surveys con - 
of ен чы years reveal that the majority 
in vocal m in our schools receive training only 
Show that ps a These surveys consistently 
Served for шеша music education is re- 
Ing ability ^s ildren who demonstrate outstand- 
to Pürehaso i music or for those who canafford 
15 apparent epis ig and lessons. Italso 
raining pro hat public school instrumental 
Sponsored grams ina majority of cases аге 
developed 50 that bands or orchestras сап be 
us, in Жалан at the high school level. 
sical inate’ latter situation, this type of mu- 
e needs of í is not primarily adapted to meet 
toward th of the individuals but rather pointed 
Altho np evelopment of a performing grouP. 
Vicarious’, most children have some sort of 
b Schoors ie mental music experience in pub- 
чо ground ДЕ as generally not accepted that a 
essary тор он instrumental performance 15 пес” 
teachers > еуегу child. It seems that music 
music equo versally assume that instrumental 
50 that талын is more demanding on pupils 
Sic are ae who show a greater talent for mu" 
пење for this training. 
an ан Зе there are obvious reasons why such 
Ueatons 49 Would be held frequently by music ed- 
Sive to руу It 18 considered prohibitively ӨВӨЙ,. 
Ve both ^ ide an opportunity for every childto 


don. m a Strumenta] and vocal music instruc- 
ite" Staff dition, it would be necessary № 09" 
the of ада Bern to teach in both areas The 
i ditional expense for the latter is not 

ne Ye Consideration; music educator? alsobe- 
el who it Would be difficult to recruit person 
is sort of 


+. Would be qualified to handle thi 
Оо, : 
Notes will be found at end of this articlee 


teaching. These are major items whichappear 
to stand in the way of a practical approach to a 
combined vocal-instrumental music course of 
study. 

It was not the purpose of this study to рго- 
vide possible solutions to these problems. While 
the writer realizes that they are not easily over- 
come, the issue investigated is: does this type 
of program fill a need in our present elementary 
music course of study? It would seem logical to 
show first that such a system of instruction is 
worth the effort. Therefore, this study was ип- 
dertaken to secure reliable objective information 
concerning the relative value of a music course 
including vocal and instrumental participation by 
the pupils as compared to one including only vo- 


cal instruction. 
The Population Sample 


The population selected for the study was the 
fourth and fifth grades of the Concord School, 
Edina, Minnesota. The Concord School is a six- 
year public elementary school with an enrollment 
of approximately 500 pupils. 

The sample was intact since all the fourth and 
fifth grade children of this school were included 
in the experiment. However, the writer found 
that this particular group of pupils could be con- 
sidered à representative sample of fourth and 
fifth grade children in the Edina elementary 
school system. Random samples of children who 
had been enrolled in the fourthand fifth grade two, 
four, and six years previously were compared to 
the present sample on the basis of intelligence (as 
measured by the Otis Quick-Scoring Mental Abil- 
ity Test * and grade point average. The tech- 

analysis of variance was applied to the 
onclusions based on the findings of this 
experiment thus must apply only to fourth and 
fifth grade children of this school system. 

In the previous spring the children had been 
into four classes by the elementary 
rincipal who was notat liberty to change 
the grouping according toa preferred random as- 
signment in the fall. That is, the entire sample 
already bad been sorted into four distinct classes. 
The principal stated that no sys tematic order 
was used in the assignation of the childrento 


nique of 
data. C 


grouped 
school P. 
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their respective groups. Therefore, interpre- 
tations of the finding of this study must recog- 
nize this particular manner of selection. Although 
the precision of the experiment was not impaired 
by this circumstance, one cannot know for sure 
whether the error introduced by this selection is 
an over-estimate or an under-estimate. So that 
the four subclasses might be equally represented, 
the records of six children were deleted by ra n- 
dom selection. Thus there were, for purposes of 
analysis, twenty-six children in each of the four 
subgroups. 'The total N equaled 104. 

А study of the occupations of the fathers of the 
subjects showed that the group could be regarded 
as a select sample in a socio-economic sense. 
The occupation of each parent was compared to 
the categorie listed in the Minnesota Occupa - 
tionalScale^. However, the tabulation showed 
that no difference existed between the control 
and experimental groups with respect to that 
criterion. 

The subgroups were likewise canvassed to 
discover if any differences existed with regard 
to previous instrumental music training. Atab- 
ulation of the number of children who had played 
instruments prior to the time of the final testing 
and the number of months of this instruction re- 
vealed no differences between the subclasses. 

The tests used in this experiment to measure 
changes in musical behavior of the subjects are 
ап integral part of the experimental design. For 
this reason the writer calls attention to the se- 
lection and construction of these devices. 


Measuring Instruments Used 


А major problem facing the investigator was 
to obtain tests to measure achievement in music 
Skills, Specifically those connected with reading 
and understanding music notation. Existing mu- 
Sic achievement tests were considered unsuit - 
able for various reasons. The tests to be used 
had to meet certain Specifications in order that 


results obtained from th: dg Ed 
able conclusions, em would merit justifi 


The instruments 
results because о 
of their construction, 


à Tests utili 
e Wes ре level primarily Should also be a 
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ability to apply this knowledge to new situations. 
Test 2, while it demands the same information 
as Test 1, was constructed to measure the chil- 
drens’ ability to match audio stimuli to visuai 
stimuli. 

Courses of study in music at the elementary 
level filed at the curriculum laboratory of the 
University of Minnesota were studied 
and materials and objectives of the music сиг- 
riculum at the Edina elementary school меге 
examined. These sources aided the author to 
determine the scope of the test. Preliminary 
forms of the two tests were drawn up and sub- 
mitted to three experts in the field of music ей- 
ucation, one of whom was the elementary music 
supervisor of the Edina system. It was through 
these steps that the investigator established the 
content validity of the instruments. 

Estimates of the reliability of both Test 1and 
Test 2 were made utilizing Hoyt’s technique by 
means of the analysis of variance3. Reliabi lity 
coefficients on the final testing for Test 1 rang? 
from .89 to . 95 іп the subgroups. For Test 2, 
the coefficients ranged from .72 to . 81. Both 
tests were found to measure sufficiently ассиг 
ately to differentiate among individuals. 

It would be of considerable value to discover 
if the effect of instrumental music instruc tion 
influenced the subjects' preference for various 
categories of music. To test this, the author 
selected the Keston Music Preference Test 
This instrument was devised by Professor Mor 
J. Keston of the Department of Psychology at M 
University of New Mexico as a means of Lope 
ing musical preferences of senior high 5С е 
students in a study he conducted in 1946-19 л 

The test is composed of thirty items; еас 1 
item consists of excerpts from four orchest 
compositions. Because each of the excerpts ft 
approximately 45 seconds in length, all four x 
оп one side of a 12-inch disc. Тһе group! Е А 
are arranged so that the same mood is expres ве- 
іп each of the four excerpts. Due to this 2-8 
ment, it is possible to say that one is not end 
ing to measure the preferences of the sub j e C 
with respect to mood. 

The subject is instructed to rank the fo 
cerpts of each item in order of his preference. 
The four categories are (a) severely classic Е ш 
(b) serious popular classical, (c) easy popula 
classical, (d) popular. 

Keston established the validity of his test БУ 
administering it to twelve expert musicians ат ч 
to students rated by their teachers as music” 
In addition, he compared his categories of e X n 
cerpts with lists of the selections in phonograP 
record catalogues. t 

Circumstances in the present study did no t 
permit an estimate of the rellability of the teS 
by means of a test-re-test, which would appear 
to be preferable. Keston established that, wit 


ton 


ur ex^ 
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his sample, the test was highly reliable. In the 
present study, a split-halves test of reliability 
Showed coefficients ranging from .88 to .97 in 
the Subclasses (final testing). Keston selected a 
Portion of his sample to discover their consist - 
елоу іп making preferences on this test. He pre- 
Sented the four excerpts of each item in the six 
Possible paired comparisons. By means of the 
Circular triad''9 criterion, he was able to дет“ 


Onstrate a high degree of consistency in their 
Choices, 


Other Measures 


ро, М This measure was obtained from the 
tioned individual school record folders; as men" 
Stru earlier, the Otis Test (Alpha) was the in- 
Seen used. In most cases, the tests hadbeen 
th inistered to the children when they were т 
е third grade, 
чека де point average - To obtain а measure of 
ice r achievement, the writer procuredthe of- 
eg ecord cards for each child and calculat ed 
grade point average for each. Only the letter 


г 
е earned during Ше year of this study Were 


Readine 
с=с comprehension - res were 
Secur rehension - These sco 


тока from the classroom teachers’ records 
he ser Ц after the spring testing program. 
Of the 1 ing comprehension test is a subtest 
len ома Every-Pupil Test of Basic Skills, 
entary Battery, Form 16. 


P 
rocedure of the Study 


h Ре the control and experimental subgroups 
a кзы class daily for the entire school year. 
e Бас to minimize the effect of the instructor, 
е pte анг taught all four subgroups Í r om 
in the ee 3, 1952, when school began 
School all, until May 22, 1953, the close of the 
ment саг. Because of the physical environ 
nat Doen 08 the experiment was staged it was 
Perime ible to differentiate the control and ех” 
the pe ntal treatments until November 17. Thus 
ae under investigation extended actually 
8Toups nty-five weeks, The class period in all 
e 25 one-half hour long. 
Control subgroups followed the course of 


Study ; 
System" Бепега1 use throughout the elementary. 
Singj,,", The great majority of time was used i 


геад With a good deal of emphasis piaca temi 

and 6 Musical notation. The solfeggio 9777 
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|: exclusively. imental 

and со Only difference between the е зара 
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he Сени of instrumental instruction- Це, 
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ment was arranged so that alternate days were 
spent for instrumental and vocal music training. 
The unit of organization in both types of instruc- 
tion was the entire class. 

Materials for the singing classes in both the 
experimental and control groups were furnished 
bythe school. The AmericanSinger series 1 
and the World of Music series? supplied the 
author with the primary source of song material. 
Nearly all of the materials for the instrumental 
program were furnished by the writer. Instru- 
ments were rented for the childrens' use from 
a local music store. The investigator also fur- 
nished the children racks, reeds, instrumentre- 
pair material and method books. The method 
book primarily used was The Boosey and Hawkes 


Band метод. 
The Design of the Experiment 


In order to obtain аз much information as pos- 
sible in the natural setting of the public school, 
the author decided to use a 2 X 2 factorial design. 
Not only would it be of value to study the effectof 
the experimental treatment, but also the effect of 
the treatment at different levels. Thus, by es- 
tablishing control and experimental groups at 
both the fourth and fifth grade levels, the study 
yieided more pertinent information. The invest- 
ator felt that the efficiency of the experiment 


и correspondingly increased and the results 


e widely applicable. | 
m assignment of the instructional method 


to the two groups at each level was decided ran- 
domly. Each class was numbered either “опе” 
or “two”. By drawing а number from a table 
of random numbers, it was decided whether the 
even- ОГ odd-numbered class should receive the 
experimental treatment. | 

тһе measuring instruments were applied at 
the beginning of the experiment and again at the 
end to determine what differences might have 
been effected by the introduction of instrumental 
instruction. The analysis of variance and co- 
variance provided the means of testing the sig- 
nificance of the differences. 


Analysis of the Data 


nalysis of variance and covariance was 
а useful test in this partieular experiment be- 
cause it revealed the significance of a number of 
components simultaneously. Furthermore, this 
tool increased the precision of the analysis by 
making adjustments in the outcomes which may 
have been due to the inequalities in initial abil- 
ities or achievement. 

Choice of independent variates - Data on six 
variables had been collected, namely, the рге- 
s of the two music achievement tests and the 


test 
Keston Test, 1.О., grade point average andread- 


The а 
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ing comprehension. It seemed desirable to de- 
termine whether or not intellectual capacity, 
achievement and reading comprehension showed 
significant relationships withthe criteria. Clear- 
ly, it would be undesirable to assume that such 
factors were unrelated to the criteria without 
first investigating the relationships. 

АП the correlations between each of the inde- 
pendent variates (reading, school achievement 5 
1.0. andthe three pretests) and Ше correlations 
between them and Ше dependent variates (the cri- 
terion measures) were computed. Thus, for each 
of the dependent variates, Test 1 final, Test2 
final and the final test of the Keston, six systems 
of simultaneous equations were solved for the 
four subgroups. Тһе method used in this study 
to solve for the unknown quantities was the well- 

known Doolittle methodl0, 

The standard partial regression coefficient 
(beta) for eachvariate was then computed for each 
subgroup on each of the dependent variates. To 
test the significance of the beta's it was neces- 
Sary to obtain the ratio value of the beta to its 
standard error in each case. Since these values 
were distributed as “t”, the significance of the 
beta's was determined by referring to the “t” 
table with nineteen degrees of freedom. 

The standard partial regression coefficients 
of the pretests of the three dependent variates 
were the only significant contributors to the 
Criteria, No significant relationship witha criter- 
ion variable was found for intelligence, achieve- 
ment, or reading comprehension in any subgroup 
at the one percent level, 


The next step in the analysis consisted of the 
application of the 


iance to test the hypothesis that there was по dif- 
ference be 


with respect to Test 1 data forariance table, 
tween method and 4 


be tested first. Note that nere iion effect must 
interaction. Due to this effect thee а significant 


tributed to the interaction was no 
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the residual error in testing the null hypothesis 
that there is no significant difference in the 
means. 

The adjustment of the sums of squares to test 
the hypothesis of no difference between Ше means 
of the experimental and control groups on Test 1 
is indicated in Table Ш. The tabled value of Fat 
the one percent level when n, = 1 and n, = 99 is 
6.90. The value of Е obtained for ‘‘between 
methods’’ іп this case is 27. 38. Thus the exper- 
imental classes achieved significantly higher 
than the controls with respect to skills measured 
by Test 1. | 

Because it was shown that a significant inter- 
action existed between the main effects of treat- 
ment and level, it was of interest to discover 
whether or not there was a significant difference 
in adjusted means for individual pairs ofsub- 
classes. А method of testing this is descr? 
by Lindquistl? and Moodl4, 

The criterion means for each of the groups 
were adjusted by the following formula: 


bed 


$! = Y; - by ба - Mx) 
where 


Үү (i= 1,2) is the adjusted criterion mean 
for the ith group. 


Yi (i-1,2)is the criterion mean for the 
ith group. ' 


ion 
by is the “within subclasses” regressio 
coefficient. 


Xj (і- 1,2) is the mean of the control var!” 
able for the ith group. 


jable. 
М, is the grand mean of the control variab 


Я еп 
The error variance of the difference peme 
the two adjusted criterion means is given БУ 
MS, т +1+ (X, - X,)? 
1 2 w(x) 
where 


г 
MSy' is the adjusted mean square for СУ! 


іп subclasses’’, 


:thinsub^ 
SS, (x) is the sum of squares for ‘‘withins 
classes Тог the control variable. 


š irst 
п; is the number of individuals in the #г5 
Eroup. 


Ç | ond 
Па is the number of individuals in the sec 
group. 


The value of “t” therefore, is equal to 
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TABLEI 


MEANS AND STANDARD DEVIATIONS ON THE 
CRITERION VARIABLES BY SUBGROUPS 


Subgroup 


Fourth grade control 
Fourth grade experimental 
Fifth grade control 

Fifth grade experimental 


Fourth grade control 
Fourth grade experimental 
Fifth grade control 

Fifth grade experimental 


Fourth grade control 
Fourth grade experimental 
Fifth grade control 

Fifth grade experimental 


Test 1 
Рејна м  0--- 
х S.D. х S.D. 
23.69 8.86 26.15 9.87 
20. 73 10.58 21.21 12.05 
23.83 8.96 22.96 9.12 
24.34 9. 67 34.50 8. 44 
Test 2 
Pretest ихээ Ез 
х S.D. x S.D. 
17.46 12.62 24.21 11.26 
19. 69 9.97 24. 81 10.37 
19.23 9.29 20. 12 12.97 
19. 12 12.21 26. 85 11.45 
Keston Test * 
pretest Е _ 
x S.D. x 8.0. 
99.04 24.17 104.50 27.70 
110.77 17.99 103.54 24,71 
108. 04 21.80 116.15 30,74 
95.15 26.72 89.15 29,93 


by а high score 


* “Poor” performance оп 


this test is 1 


indicated 


ANALYSIS ОҒ VARIANCE AND COVARIANCE TO TEST THE HYPOTHESIS OF NO INT 


TABLE II 


BETWEEN GRADE AND METHOD WITH RESPECT TO TEST 1 FINAL SCORES 


ERACTION 


—y — 
Source of 2 2 Adjusted 
Variation df. Ху Хх Zxy 4.1. 8.8. M.S. F Hyp. 
Within subclasses 100 9,927.9616 9,106. 6924 6,889.0 99 4, 716. 5941 47. 64 
Interaction 1 706. 1635 100. 0384 265. 7885 1 361.2847 361.28 7.58  Reject 


О 


Source of 
Variation 


Within subclasses 
Between levels 


Between methods 


TABLE III 


ANALYSIS OF VARIANCE AND COVARIANCE OF TEST 1 FINAL SCORES 
WITH TEST 1 PRETEST SCORES HELD CONSTANT 


d. f. 


100 
1 


1 


>у2 
9,927.9616 


106. 0096 


1,040.7788 


zx? 


9,106. 6924 
71.1154 


26.0 


Уху 
6, 889.0 


86. 83 


-164.50 


4.1. 


99 
1 


1 


Adjusted 
S.S. М.5. Е. Нур. 
4,716. 5941 41.64 
15.3405 15.34 -- Ассерї 
1,304.5395 1304.54 27.38 Reject 


925 
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With degrees of freedom km - k - 1 where k 
equals the number of treatments or levels, and 
m is the number of observations in each c ell. 
ғ Since the difference between апу two of the 
Our subclasses represents just one of six pos- 
Sible comparisons, the probability level ге - 
Eod for significance is not set at 1 in 100 but 
icd іп 100, or .0017. А situation of this type 
реду Тоһпзоп 19. These tests were 
TR оп each of the six possible comparisons. 
са: i experimental group proved to be signifi - 
ine ly different from the control group at the 
th grade level, but not at the fourth grade. 
c, Matching of audio and visual stimuli - The 
anp Ог interaction on data from Test 2 yielded 
tera of 5. 0 so that the null hypothesis of no in- 
in MON between treatment and level remained 
ue je (.05» р›,01). However, the variation 
he О the interaction effect was not pooled with 
16 residual error to test the hypothesis of no 
Їегепсе in means. 

Seu analysis further revealed there was no 
«Tu жара difference between the means of the 
Spect ge and the control treatments withre- 

2. О the skills measured by this test (F = 
able to Due to the fact that it was not reason - 
e ‘en ыы there was no interaction between 
advisable effects of treatment and level, it was 
ore t le to proceed in the same manner as be- 
No. test between individual subgroups. 
e Significant differences were discovered 
other. the subclasses were compared with pach 
Was fc It should be noted that the value of "'t 
Cont ound to be 2. 76 when the experimentaland 
p groups at the fifth grade level were test- 
their = hypothesis of no difference between 
in doub justed means must, therefore, remain 
Meet (- 015 р». 0017). 
lance Ба Preference - The analysis and covar-, 
the m, howed that it was possible to assume tha 
Spect to effects of treatment and level with ге“ 
depende the scores on the Keston Test were - 
to int lent of each other. Since the variationdue 
ble to Faction was not significant, it was possi 
fieq „2901 it with the variation already identi 
as residual, | 
ны imin analysis further showed that the test an ы 
esp ted significantly between the үү 
13. 62 control classes. Е was computed to 
Within Р‹.01). Thus, it was сопс à 
bined , 8 limitations of the experiment, 
Саур PProach of vocal and instrum 
жа i 1 alon 
Preferennes Superior to vocal а. 
a titerion ке measured IY а this to be true 
Íourtn Я 15 so it was not 
h and fifth grade leve 
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necessary to proceed beyond this pointas-was 
true in the other two instances. 


Other Data 


In order to reveal trends in the attitudes of 
the children's parents as to the value of combined 
vocal and instrumental training, а questionnaire 
canvass was made. Each set of parents of the 
children in both experimental control subclasses 
was requested to answer a twelve-item question- 
paire when the experiment was nearly completed. 
A one hundred percent response was obtained 
since the questionnaires were taken home andre- 
turned by the children. 

The response totals for each item were tabu- 
lated and then tested by the chi-square technique 
and significance accepted at the five percent level. 
Not all the items discriminated between the “ех- 
perimental parents” and the ‘‘control parents" 
and there was some variation between the two 
levels. However, it was apparent that the par- 
ents of both fourth and fifth grade pupils accepted 
the program. 

More of the parents of the children in the ex- 

erimental groups felt their children had been 
stimulated to continue the study of their mus ic 
than those of the controls. Another significant 
finding was that the experimental parents felt 
that the introduction of instrumental music to the 
curriculum would not tend to place too much em- 

hasis on music in relation to the rest of the 
school program. The control parents’ responses 
were significantly different at the five perce nt 
level on both of these points. Thus, ingeneral, 
it appeared safe to assume that the parents ofthe 
children who had participated in the experimen- 
tal course of study favored it. | 

Toward the end of the school term, the chil- 
dren in each of the four subclasses were givenan 
alphabetized list of all the subjects includ ed in 
their curriculum. The classroom teacher inevery 
case administered the questionnaire and the chil- 
dren had no indication that the main object of the 
device Was to discover the ranking givento music. 
The instruction given to the pupils by the class- 
room teacher was that the children rank their 
subjects in the order in which they liked them. 

To be sure, the information thus receive d 
ot an absolute index of their preference for 


was n à 
music. It was, rather, a relative measure be - 
cause the individuals were forced to compare mu~ 


sic with the other subjects in the curriculum. 
However, this method seemed preferable to the 
more commonly-used rating scale device, раг- 
ticularly at these grade levels. Thechi-square 
test was used for determining the significance 
of the difference in the distribution of ranks 
assigned. A significant difference in favor of 
the experimental class was found at the fifth 
grade level (P <. 001) but not at the fourth. 


ь ай 
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Implications 


The fifth grade experimental class attained 
significantly higher scores on Test land the 
Keston Test than the fifth grade control group 
and the null hypothesis remained in doubt on 
Test2. Тһе pupils in this class also ranked mu- 
sic significantly higher on the subject preference 
list than the other fifth grade. The fourth grade 
experimental subjects did not do as well, although 
Table I shows the same trend in both the fourth 
and fifth grades. 

These findings would seem to suggest that it 
might not be advisable to introduce a combined 
vocal-instrumental curriculum until the fifth 
grade. At least, the criterion of achievementin 
reading and understanding music notation indi - 
cates such a conclusion. On the other hand, an- 
alysis of music preference scores showed that 
the experimental method produced effective r e- 
Sults in both fourth and fifth grade experimental 
classes. Thus it is possible that fourth grade 
children are learning skills and attitudes not 
measured in this experiment. Further study and 
the use of other criteria would help Supervisors 
to make such decisions if a program of this type 

were to be adopted. 

The analysis of the data collected strongly 
indicates that the integration of both vocal and 
instrumental instruction would tend to develop 
within the pupils a broader base of musical 
comprehension than can be obtained through vocal 
training alone. Responses to questionnaire de- 
vices lead one to believe that such a programis 
more interesting for children and that parents 
would be satisfied with the arrangement. 


plex nature that a one 
strumental program 
Again, the effects of 


-year combined vocal-in- 

might not be sufficient. 

TE dual instruction may 

г ү ег years so thatthe find- 

ings of this study do not ive a tr i 

changes in the subjects, 8 на 

To answer some of these i i 

questions 

has collected data on all of the iecit эх t = 

same pupils used in this study one School year 

after the experiment ended, Analysis of thes e 


JOURNAL OF EXPERIMENTAL EDUCATION 


(Vol. 23 


data will be of value because the results will be 
more widely applicable for the music educator. 
The findings of this follow-up study will be pub- 
lished in the near future. 


15. 
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A COMPARISON ОЕ VERBAL AND PICTORIAL 
SELF-RATING-SCALE CATEGORIES 


JULIAN C. STANLEY* 
University of Wisconsin 


DO VERBAL reference points on a 56 lf- 
rating scale result in different marking from 
pictorial ones 2 
т Chester Е. Evansl** раз devisedtwo forms 

а “personal satisfaction" inventory which 
are virtually identical except that the five cate- 
е of response on one are words (very satis- 
22 satisfied, neutral, dissatisfied, very dis~ 
i isfied), while on the other they are five smil- 
ас neutral, or scowling facial expressions of 
the a: Sample items from the inventory are: 

{ city in which you live, your last boss, our 
oreign policy, 2 


Design of the Stud 


un Pied to ascertain whether or not the two 
effects reference point anchors have different 
twice tc the writer administered inventories 
in two о each of 48 college students of bothsexes 
In the acquired courses, as outlined in Table I. 
viduals child psychology'' (CP) class, 24 indi- 
Seats i меге assigned at random to а lte rnate 
row fill four rows. Allsix persons іп the first 
after а ей out the “words” inventory, followed 
by th 15-minute period of irrelevant activity 
Tow (e faces” inventory. Those in the third 
сеіу even-numbered rows were left vacant) re- 
row ед “faces” and then “words. '' The fifth 
Sev had “words”? followed by “words, ” and Ше 
o “Часев” followed by “Часев. » proced- 
(Ер), ав similar in the ‘educational psychology 
а сы, except that because of shorter rows, 
chine” were made to alternate seats 11 

in Words d Rows 1 and 5 received inventories 
апат -faces order, 2 and 6 faces-words, 

Ore Words-words, and 4 and 8 faces-faces- 
tested. nons than are shown in Table I w ° n 
1еауе < but enough were eliminated randomly 10 
the Sta: ix in each class-design-order group for 

tistical analysis. 
tha Students realized that any шин Š! - вег 
T one they experienced was being .. 
199 Second ев were not mentioned until 
inutes after the first ones were тие. in, 
Went © Which interval regular class activities па 
theo n. Тһе EP class ended at 11:50 a. p. d x 
er began at 1:20 p. m. the same day; aP 
* 
te Writer is indebted to Professo" palmer 0» 
Teporting of this studye 


зөв 
ferences and footnotes will be 


found at end of 


parently, no information concerning the ехрегі- 
ment leaked out during this 90 minutes. 
Satisfaction inventory scores, the dependent 
variable, consisted of mean item scores expres- 
sed on a 0 (very dissatisfied or heavy scowl) to 
4 (very satisfied or broad smile) scale, multi- 
plied by 100 to eliminate decimals. Since a few 
of the 50 items did not apply to many of these stu- 
dents (e.g., ‘‘your husband or wife"), the divisor 
was usually slightly less than 50. The 96 three- 
digit scores ranged from 178 (100 - dissatisfied, 
200 - neutral) to 328 (300 - satisfied), with a 
grand mean of 241. 


Four Ways to Analyze the Scores 


The Table I scores may be analyzed inatleast 
10 partially different ways, but we need be con- 
cerned with only four of these. 3 ош chief inter- 
est is in the «‹апсһог” (*^words" vs. ‘‘faces’’) 
шаш effect. This сап be tested in three differ- 
ent ways: by considering only scores from the 
first inventory; 45 in Table II; by treating the 
two non-crossover designs (1) together, as in 
Table III, where «anchor? is a between-individ- 
uals main effect; and by treating the two cross- 
over designs (2,3, 4, 5, 6, 7) together, asin Table 
тү, where **anchor" is а within-individuals main 
effect. А 
The first of these, in Table II, is the most 
powerful, having 44 d. f. for the ‘error’? mean 
square, and it also provides a statistical test 
for the class" main effect and the “class X 
anchor” interaction. 

The pooled non-crossover design analyzed in 
Table Ш tests the same three sources of varia- 
tion as the Table П procedure but with just 20 
а. ғ. for error"; in addition, it tests the ‘‘se~ 
quence" main effect and the three interactions 
¿sequence? with “class” and “алсһог.” 
The Table IV replicated latin-square design 
involves administering both inventories to each 

like the other two methods, so that 


student, un 
cores for “words” are correlated with those 


for “faces.” 

Thus with respect to ‘anchor’? differences, 
Tables H, Ш, and IV answer three questions: 

1. If two random groups are tested, one with 


Johnson for several helpful suggestions concerning 


this articlee 
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TABLEI 


OVERALL DESIGN FOR COMPARING “WORDS” AND “ҒАСЕ5” ANCHORS 


First Second 
Class Design Order Individual Inventory Inventory 


1 | Words Faces 
Words, Faces 
(Words first) 
6 Words Faces 
Crossover —P 
7 Faces Words 
Faces, Words 
(Faces first) У 
12 Еасев Words 
“Child 
Psychology" 
(CP) 13 Words Words 
Words, Words 
(Words first) i Š 
18 Words words 
Non- 
Crossover БД 
19 Еасез Faces 
Faces, Faces 
(Faces first) 
24 Faces Faces 
25 Words Faces 
Words, Faces 
(Words first) Š ü 
30 Words Faces 
Crossover 
[ г ои 2 2 
31 Еасез Words 
Faces, Words 
“Educational (Faces first) x . 
Psychology”? 36 Faces Wort 
(EP) Е Luce — _ 
37 Words 
Words, Words noe 
(Words first) I 
Non- 42 Words words 
Crossover Е 
сез 
засаа, аад 43 Еасев Еа 
(Еасев first) š . b 
dic MEE NN 48 Faces Faces 
MR | Kf (f f f J. = 
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TABLE II 


ANALYSIS OF VARIANCE FOR THE 48 INVENTORIES ADMINISTERED FIRST 


Source of Variation Sum of Squares d. f. Mean Square Е 
Between classes 4, 408. 33 1 4, 408. 33 5.16* 
Between anchors 33.33 1 33.33 
Class x anchor 456. 33 1 456. 33 

37, 597. 00 44 854. 48 


Within class-anchor groups** 
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Total 42, 495. 00 41 


* Significant be 
yond the . 05 level. я quis нео А 
"аен test yields а corrected chi square of 12.71 with 3 d.f., which is significant beyond 
€ . 01 level, for the four class-anchor-group vari 
Pooled to yield the error term. The estimates are 486, 305, 512, and 2114. 


TABLE Ш 
ANALYSIS OF VARIANCE OF THE TWO NON-CROSSOVER DESIGNS TOGETHER 


шш 1 6,302.08 3.33 
ын 1 2,214.08 Л” 
Class x anchor 1 1,716.33 
| .50** 
Individuals within class-anchor groups 20 1,894. 98 118.50 
Sequence i м 
36. 75 2.30 
Class х anchor х sequence 1 
0 
Class x Sequence 1 
0. 33 
Anchor х sequence 1 
Individual х sequence within class- 4 -— 
7 
Total 4 
: jed to four decimal places. 
Com squares carrie 
жж puted from mean Ч el. 


Significant beyond Ше. 


ance estimates whose sums of squares are 
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TABLE IV 


ANALYSIS OF VARIANCE OF THE TWO CROSSOVER DESIGNS TOGETHER 


Source of Variation d. f. Mean Square Е 
Огдег 1 2, 106.75 1.31 
Class x order 1 280.33 

Individuals within class-order groups 20 1, 603. 68 33. 65* . 
Sequence 1 8.33 

Order x sequence (anchor) 1 96.33 2.02 
Class x sequence 1 44. 08 

Class x anchor 1 102. 08 2.14 


Individual x Sequence within class- 
order groups 


20 47. 66 
Total 41 


*Significant beyond the , 001 level, 
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TABLE V 


OVERALL ANALYSIS OF VARIANCE OF SCORES IN TABLE I DESIGN 


Source of Variation d. f. Mean Square 
Between individuals 
Class 1 9,720.38 
Design 1 805. 04 
Order (W first vs. F first) 1 0. 67 
Class x design x order 1 322.67 
Class x design 1 187. 04 
С1а55 х огдег 1 1,734. 00 
Design х order 1 4,320. 17 
" Individuals within CDO groups 40 1, 749. 32 
“Within” individuals 
Sequence 1 1.04 
Class x design x order x sequence 1 ыл 
Class х design x sequence 1 шэн 
Class x order х Sequence 1 лат 
Design x order x sequence 1 en 
Class x — 1 22.04 
НИН i 9. 38 
Orders — 1 54. 00 
РА 31.82 


іні 


5.56% 


2.47 


54, 97** 


4, 11965 


1,34 


1.70 


Individual x sequence within СРО groups 


Total 95 


* A 

жж Significant beyond the . 025 level. 

жж Ва сале beyond the . 001 level. 
ignificant at the . 05 level. 
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TABLE VI 


VARIANCE ESTIMATES THAT WERE POOLED TO YIELD THE TWO 
ERROR TERMS IN TABLE V 


Class-Design-Order 


Mean Square 


Group d, £. Between Individuals 
CP, Crossover, WF 5 981.53 
CP, Crossover, FW 5 329.35 
CP, Non-C, WW 5 1,074.28 
CP, Non-C, FF 5 576.80 
EP, Crossover, WF 5 1,308. 33 
EP, Crossover, FW 5 3, 975. 48 
ЕР, Моп-С, уду 5 624.13 
ЕР, Коп-С, ЕЕ 5 5,304. 68 
ch aae AES arty u 


15. 
14. 


38 
07 


(Уо1. 23 


March, 1955) 


“words” and the other with “faces,” will their 
mean scores differ significantly? 

2. If two random groups are tested twice 
each, one with ‘‘words’’ both times and the other 
With “faces, ” will the means of their two sum- 
med scores differ significantly? 

1.3. If two random groups are tested, one with 
еа followed Бу ‘Часез’? and the other with 
48265” followed by “words, ” will the mean for 

Words? differ significantly from that for “Часев ?” 
ш we are not trying to answer the вес- 
вене нат The first and third questions аге 
юмын equivalent, so it would seem most 
plo € with a fixed number of subjects to em- 
in d, Only the crossover design for all members 
for Ди Class, thus reducing Ше “еггог” term 

e Ni anchor main effect by taking into account 
“Час igh correlation between “words” and 
сеа besides providing as many degrees of 
The ЫШ) for “error” as the Table II analysis. 
Вы design requires retesting each 

ut it Алда considerable degree of control, | 
able iis correlational information not avail- 
So, it еп each person is tested only once. Al- 
ical] will often be more efficient, both statis~ 

e ала financially, to secure 96 scores from 

minees than 96 scores from 96 examinees. 

and е, the Table I mixture of сг ossover 
егепсе crossover designs permits us [о test dif- 
Whethe 5 among the eight r's andthereby to see 
ients өт ше “ипаНКеалсһог” reliability соейіс- 
сое ст ег significantly from Ше ‘test-retest 
are to ШЕ. They should not И Ше two forms 

The T regarded as interchangeable. 

Whole l'able I design cannot be analyzed аз а 
Without losing the ‘anchor’? classifica" 


tio. 
de by dealing with “order” (‘words inventory 
ав sh first” vs, “faces inventory taken first”), 
own in Table У. 
Results 


signifie ds” and “Часев” anchors do not differ 
Узез ста У from each other іп any of the ала!, 
intera ables II, Ш, and IV), nor does *tanchor 
Tables Significantly with class or sequence. 
beyong Папа У the classes differ significantly 
action (Pe . 05 level, and in Table V the inter. 
3 Siga, lass, order, and sequence а 
number бам. However, because of the large 
їл. Тару 9f significance tests run (15 main ones _ 
1апсе Bh V) and the heterogeneous “error _ 22% 
leant о син in Table VI, this apparently sign Ж 
ю changa © X S mean square тау be attri?" 


i : А 1еаг. 
The с> H real, its meaning is not с 
1 eigh : › h based upon 
pairs o t Pearsonian г’з, и | for the СР- 


Í Scores, range from р- 
©говвоует сев first group to - 9961 for the E 
Qui ~faces fi ь № Ж 
lation tents of fea дл an estimated рорч 
Variance of 0, 6182, compar 


ppears to 
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theoretical variance of 0. 3333 for random-sam- 
ple z’s based upon six pairs. The ratio of 0.6182 
to 0.3333 is a non-significant F of 1.85 with 7 
and infinite degrees of freedom.4 Thus the eight 
r’s do not differ significantly from each other. 


Discussion 


The two chief findings from the analyses out- 
lined above are high correlation between the in- 
ventories and somewhat greater personal satis- 
faction in the EP class than in CP. Perhaps the 
CP class members, chiefly first-semester jun- 
iors enrolled for their initial course in theSchool 
of Education, were under more tension than the 
first-semester seniors in the EP class, who had 
already been self-screened for malcontents. Sev- 
eral alternative hypotheses are equally plausible, 


of course. | 
‘words’? апа “faces” means do not differ 


significantly for the college students employed 
as subjects in this study.9 Scores on the two in- 
ventories have similar variability and appear to 
intercorrelate highly. Obviously, it is possible 
that other verbal categories would produce reac- 
ns different from the faces, since the word 
" may be quite indeterminate. It should 
be interesting to compare various rating-scale 
markers, such as the numbers +2 through -2 or 
ips on а line, with the word and face anchors. 
Although the satisfaction inventories origin- 
ated in industrial situations, results of this study 
should not be over-generalized. There may be 
marked differences between the reactions of ad- 
vanced college students and industrial workers. 
Some of the designs discussed here should be 
suitable for experimentation with various non- 


college groups. 


tio 
“every 


Summar 


48 college students an experiment- 
al design involving both crossover and non- 
crossover principles, the writer shows by four 
analyses of variance that two “personal satisfac- 
tion” inventories devised by Chester E. Evans 
which have words as rating-scale reference points 
in one and faces in the otheryield equivalent 
mean scores, differentiate between two c o llege 
classes, and intercorrelate approximately . 96. 


using with 
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FOOTNOTES 


lEmploye Research Section, General Mo- 
tors Corporation, Detroit 2, Michigan. 
Twenty-seven of the 50 items were origin- 
ated by Joseph Weitz (8). Two other sources of 


(Vol. 23 


information concerning the history and develop- 
ment of the satisfaction inventories are Tech- 
nical Bulletins No. 10 and 16, Employe Research 
Section, General Motors Corporation: Theodore 
Kunin, ““А Study in the Placement of Faces Along 
Subjective Continua, " June, 1950, and "The 
Weitz-Evans Community Checklist, ' January; 
1954. Kunin's report, an M. A. thesis at West- 
ern Reserve University, is scheduled for с on _ 
densed publication in а forthcoming issue of Per 
sonnel Psychology. The present writer is 1n” _ 
debted to Dr. Evans for furnishing the invento. 
ries and calling his attention to their anteceden . 
ЗТһе composite design of Table I involves 
two crossover and two non-crossover aee p " 
each of which four might be subjected to апа е 
ysis of variance separately, and two С lasse E 
which might also be analyzed apart from ан 
other. Тһе writer has done these six pee 
for his own information and will be glad to pem 
respond with interested persons concerning 
but they are not discussed in this article. kis 
This procedure is equivalent to the € 
square test outlined by Edwards (3: 135). andom 
5біпсе no population was defined and г 2 
samples taken from it, conclusions mus пенса! 
ited to these 48 subjects or to some hypot ae 15 
population for which they might be concelv 
constitute a random sample. 


THE INTERPRETATION OF THE STANDARD 
ERROR OF MEASUREMENT 


C. H. PATTERSON 
Veterans Administration Regional Office 
St. Paul, Minnesota 


sss USE oí the standard error of meas- 
Ширэн a measure of the reliability of test 
perts (18:2 been recommended Бу some test ex- 
measuren 22). Since the standard error of 
Stated i ren applies to a single score, and is 
more = Pepe of test score units, it is much 
reliabilit ul in counseling individuals than the 
Out in B coefficient. Although Kelley pointed 
urement 2 45) that the standard error of meas- 
of score is relatively independent of the range 
siderable (or ability), a factor which has con- 
this ere coefficients of re liabi lity, 
ditions (7.2000. only under certain con^ 
bili any the writer, in discussing the relia- 
cales (23) е Wechsler-Bellevue Intellige nce 
Td erro ), had occasion to refer to the stand- 
With this measurement of an IQ 0 btained 
Severa] | ои Reference was made to 
Covered th; ndard statistical texts. It was dis- 
the standa at many texts make no reference to 
28,30) етегі error of measurement (3, 25, 26, 
Pretation ile others give no definition ог ішег- 
recent bo of it. It is interesting that Cronbach’s 
ПО menti oh п psychological testing (1) makes 
the rece "+ of this measure of reliability. In 
едцед Ж volume on educational measurement, 
his exc s: E. F. Lindquist, R. L. Thorndike, in 
is s chapter on reliability (27), refers 
ШЕ ог = but does not discuss its mean 
Parent са the lack of information and the ар- 
ег felt ивавгеетеп of interpretation, the writ- 
Would р it other test users and counselors 
ing ane® interested in a discussion of the пат 
bility interpretation of this measure of relia- 
Garrett he controversy between Guilford and 
Issues (5,6,9) apparently has not resolved the 
Although it appeared that Ga rr ett 7 
inm чпда тета у with Guilford, ће persist 
вез aintaining his disagreement, and іп 25- 
Preta, е equivalence of two different inter- 
tions, 


а 3 
enced f 


he je 
Озу ас алдата error of measurement, VATI 
Org. -Signated as ое, 0, оо» OF 93-07 буу? 
15 given ав 


1 
Wh 91] = S,V1 -rir а) 
Etes , š distri- 
bution di 1S the standard deviation ді ST. гу 
i 


Сое? безі scores, and ri: 


th 
lent of the test, preferably based оп te 


correlation of alternate (equivalent) forms. 
This formula gives the standard error ofanac- 
tual observed score; the standard error of meas- 
urement is the standard deviation of the distri- 
bution of the scores an individual would make 
on a large number of testings with equivalent 
forms. The meanofthis distribution of obtained 
scores would be the individual's “true score" 
on the test. 

A number of the various interpretations of 
this measure will be quoted and discussed. 

1. One type of interpretation consists of state- 
ments concerning the true score of individuals 
obtaining 2 specified observed score. These 
statements are in the form of the probability of 
the true score falling within specified limits of 
the obtained score. It is stated, usually, that 
the true score of an individual making a вресі- 
field score is almost certain to lie within three 
standard errors of the obtained score, or, that 
the chances are approximately 68 out of 100 that 
the true score lies within one standard error 
of the obtained score. Peatman, for example, 
referring to the confidence limits of an IQ of 109, 
given à standard error of 4. 5, states: ‘‘,.. thus 
it is likely that persons with an 19 score of 109 
have parameter (i.e., true) scores whose val- 
ues lie between 100. 0 and 118. 0; and we can be 
quite confident that the parameter values will 
not be 1255 than 95.5 or greater than 122.5" 

While not an exact probability state- 


4:379). 
pend in appears to be of the form stated 


above. я 
2. Guilford (8:414) points out that such state- 


ments imply the prediction of the true score 
from the observed score. This would require 
the standard error of estimate of a true score. 
In another place (10:480) he states: “Апу ob- 
tained score does not tell us what the corres~ 
ponding true score is, but with knowledge of 

со we can have a degree of confidence that 
the true score cannot be very far away." This 
implies that no exact statement concerning the 
true score can be made from an observed score. 
AS Lindquist points out (18:221 footnote), the 
standard error of measurement is the standard 
error of estimating an observed score ona test 
from the corresponding true score. Thus the 
proper interpretation of the standard error of 
measurement is in terms of the distribution of 
obtained scores for a given true score. Guil- 
ford (8:414) gives as the correct type of state- 
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ment: “Па certain individual has a true score 
of 50 points in the test, then we may expect two- 
thirds of all his actual scores to lie between 
46 and 54"' (given a 0,00 of 4). Lindquistagrees 
with this interpretation (18: 221-222). 
Variations of this type of interpretation are 
in terms of the probabilities of any observed 
Score falling within certain limits of the true 
Score, or the probabilities of the obtainedscore 
differing from the true score by a given amount, 
Say, one or more standard errors, or probable 
errors. For example, Kelley (15:79) writes: 
4... the chances are fifty in one hundred that 
the pupil's obtained score differs from his true 
ability score by an amount greater than [one 
РЕ|.” Garrett also follows this latter inter- 
pretation. He says (using a PE of 3): “This 
result may be interpreted to mean that the 
chances are even (50 in 100) that the obta ined 
Score of any individual in the group ...does not 
differ from his true score by more than +3 
points" (7:321). 

It will be noted that these interpretations dif- 
fer from those of Guilford and Lindquist in that 
they make statements concerning an individual 
Score. That is, they assign a probability to an 
individual score, rather than to a distribution 
of scores. The error of this procedure will be 
discussed later. 

Gulliksen also follows the interpretation in 
terms of obtained Scores, in the manner oí 
Guilford and Lindquist, He States that, ©... 

In general, по probability statements can be 
made to apply to all persons who make a given 
observed score, We can only make the state- 


hers i 
Garrett (7; 320), ? including McNemar (24) and 
taken as an estim: 


Kelley defines the зы Core. While 
ndard 

ment as “Ше Standard deviation of. f teas Е. 

for a given fixed value Single scores 


> г of 
is equivalent, for him, ta ie true Score, ” this 


tion of errors of estimat Чапйата devia- 

: е ^ 

18 taken as evidence оға mue ше Single score 

A qe zs Kelley makes interp 05:11), 
ch as the following (given а Scar etations 

a standard error of 7, 12): «т Te of 70 and 

in six that John’s true ability He жн спапсе 


10% 62.3, 
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So that there are four chances in sixthatit lies 
between 62. $ and 77.7” (15:172). In another 
place Kelley writes: “бүср may correctly be 
used to indicate the standard error when x, (an 
obtained score) is estimated from a knowledge 
of хор (a true score)(a process actually never 
performed), or when хсо is estimated by using 
non-regressed х,’ (16:403). 

These statements concerning the true score 
are similar to that of Peatman quoted before. Эн 
However, Peatman does not specify that the о 
Served score is taken as evidence of the tr poit 
Score. There is a difficulty in the nature of ү 
statements made which will Бе referredto ја нэ ` 
The correct form of statement regarding а i 
Score on the basis of the standard error of me 
observed score which is taken as evidence о b- 
true score is of the type that for a given will 
served score, the corresponding true a he 
fall within a given interval, determined by а 
observed score and a multiple of its атап dee 
error according to the confidence арален 
Sired, and we shall be rightinthe statemen ec- 
the interval will cover the true score in à 5 
ified proportion of the cases corresponding ü 
the confidence coefficient selected. Its ho nits 
also be stated that the confidence interval li 
are random variables. 

4. There is a second way inwhichstate true 
about true scores may be made. While itis true 
that the observed score is anestimate of а даа 
Score, it is not Ше true score, пог the kem 
timate of the true score. Using an obs va ар” 
Score as the estimate of Ше true score а score 
plying the standard error to the observe as Ке!- 
as if it were the error of the true score ( pe 
ley does above) may be confusing. It dre 
argued that the best estimate of the true ash 
is one obtained as a result of prediction en 
upon the regression of the true scores UP? p. 
observed score, rather than accepting Ше. оле» 
Served score as Ше estimate of the true dicting 

The standard error of estimate in pre@ ns 
а true score from an observed score by m 
of a regression equation is given by 


0001 =-Б1/1 ryr УГ: т (2) 


ments 


со = 8,Угү(1 - Гут) 


Where s, is Ше standard deviation of the г y 
Served scores and r,, is the coefficient hà - 
liability of the observed scores. Since = i 
liability coefficient is always less than Om e will 
is clear that the standard error of estimat e 
always be less than the standard error of ™ 
urement. That is, the error of a гергевве 
Score taken as an estimate of true score нэ 
ways less than the error of an obtained $C 

еп аз an estimate of a true score. 


ч 
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"s usual interpretation of the error of esti- 
Cludi 15 in terms of the confidence interval in- 
that (fe the true score. Thus it may be stated 
ease Ч additional samples) іп 99 percent of the 
їнэн пе true score falls within the interval + 
г Standard errors above and below Ше esti- 
mated true score. 

Bedae лаана error of estimate of a regres- 
ability g^ Seldom used as a measure oí reli- 
be gained наана writes: “There is nothing to 
Predicti y [predicting true scores] for the 
Scores pim would be no more accurate than the 
Kelle rom which they were obtained" (10:479). 
mate e however, states that “to secure an esti- 
cases t true ability, [this ] process is in а11 
not oun? best, but if reliability is high, it is 
labor” "m better....to warrant the extra 
Practical). 181). Gulliksen agrees that “по 
8гезвіо advantage is gained from using Ше ге” 
45), п equation to estimate true scores” (11: 


шай 28 exact probability statement can be 
given M eoa, > the group of individuals witha 
limits. "Vd Score. However, reasonable 
vidua] may be set for the true score of an indi- 
describes” а given observed score. Gulliksen 
also indie the procedure as follows: “Ме may 
it valie te a method for assigning a probabil- 
Served sc 9 the statement: ‘If a person's ob- 
etween 50 a, is 65, his true score probably lies 
ability val апа 80 (+ Зо, о). ` Note that no prob- 
all petso ue is given. We cannot say that for 
Drobability whose observed score is 65, the 
“Core 18 Ea is greater Шал . 99 that the true 
the stat etween 50 and 80. However, consider 
tween erg: ‘This person's true score lies be- 
Were kn and 80'. If the person's true score 
Person pv the statement could, for a given 
Sach of the classified as true or false.... For 
known he persons whose observed score 18 
au Boron a statement can be made.... FOr 
that the 015 in the distribution, it will be found 
реге Statement regarding limits is true over 
three | Mt Of the time and is false less than 
imes out of a thousand. In other words, 
e 4, савез were considered, а probability | 
i attached to the truth or falsity of the state” 
ifieg ја ‘true score is included within the зрес 
ment io dh. ' However, if we limit the 5 tate- 
ПО asse Persons with any given observed Score; 
"tion regarding probability can be made. 


M c 
Score i Зу then that for a person whose observed 
ir 5, reasonable limits for his true sco 


© 80" (11:17-20 

Carlier Ments Such as dat of Peatman, ped 

"Se фет? may be technically correct, cere 
MS Such аз “likely” and «quite соп! 


Мот 


he no... 
Son, PSSibility of applying tole 
lversity of Minnesotae 
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dent." However, they are misleading іп that 
they imply exactness to the reader. АП that 
can be done is to set ‘‘геазопа е limits" for 
the true score, without assigning exact proba- 
bilities. 

6. A method of assigning exact probabilities 
rather than ‘‘reasonable limits’’ to statements 
referring to a group of individuals withagiven 
obtained score would appear to be possible 
through the use of tolerance limits. 1 Tolerance 
limits determine an interval which will include 
at least a specified proportion, P, of the distri- 
bution, with a specified confidence. 

Tolerance limits are of the form 


Ха Ks (3) 


where X and s are the mean and the standard de- 
viation of the sample, and K is one-half of the 
tolerance interval, which may be determined by 
erence to a table in which values of Kare giv- 
en for specified values of P, of the confidence 
coeíficient or level desired, and of N (4:102-107; 
also reproduced in 2, Table 16 in the Appendix). 
In the present application X would be the obtained 
score (taken as an estimate of the mean of the 
distribution of obtained scores in repeated test- 
ing, i. 8, of the true score), and s is the stand- 
ard error of measurement (taken as an estimate 
of the standard: deviation of the distribution of 
obtained scores, i.e., ofanestimate of the stand- 
ard error of the obtained score taken as an esti- 
mate of the true score). In repeated testing on 
ent tests, the group of individuals with а 
btained score on the first test would ob- 
res on the other tests, and the 
standard error of measurement would also vary 
from test to test. Tolerance limits enable one 
to state, with à specified degree of confidence, 
the interval which will include a specified pro- 
portion P of the obtained scores. 

As an example of the procedure, let us take 
an obtained Score of 50, with a standard error 
044. Itis desired that tolerance limits be set 
which will include 95 percent of the obtai ned 
scores in future samples, or on equivalenttests, 
with а confidence of . 99. The N would be the 
number of cases entering into the determination 
of the standard error of measurement, say, 100 
in this example. K would in this case be 2.355. 
The interval would then be 50 + Kg, ар; ОГ 40.58 

We can thus be sure, at the . 99 confi- 
vel, that in repeated testing of this 
f 100 cases (or in other samples of the 
), 95 percent of the obtained scores 
tes of the true scores) of the group 
ginal obtained score of 50, will fall 


ге! 


equival 
given 000 
tain varying SCO 


-59. 42. 
аепсе 1е 
sample 9! 
same size 
(or estima! 
with an Or 


situation was Suggested by Dr. Palmer O, Jomm- 
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within this interval. That 15, in 99 percent of 
the equivalent tests, 95 percent of the obtained 
scores will be included within the interval (or, 
still differently, 99 percent of the tolerance 
limits determined from repeated tests will in- 
clude 95 percent of the scores). If we desired 
to include 99 percent of the scores in 95 percent 
of the tests, the limits would be 38.26 - 51.74. 
By increasing P we can, with a corresponding 
increase in the size of the interval, includea 
greater proportion of the scores. 

Finally, it is necessary to consider the na- 
ture of probability statements regarding confi- 
dence intervals within which a given parameter 
such as a true score, lies. The true score is a 
fixed value, not a random variable. (InFisher's 
concept of fiducial limits, the parameter is the 
same as in the case of confidence intervals.) 
Since it is fixed, it either is or is not within 

the confidence interval in a particular case, and 
the probability is either unity or zero, respec- 

tively. The probability therefore applies to the 
Statement, which will be true in the proportion 

of cases specified by the confidence coefficient, 

and not to the individual score2 (12:111; 22:221- 
222; 29:258-261). 

It would appear to follow that any statement 
concerning an individual score must take the 
form given above. Thus, the correct statement 
concerning a given observed score would be of 
the type: ‘‘This individual's observed score lies 
Within plus and minus one standard error of his 
true score, and we shall be correct inthis state- 
ment in 68 cases out of 100,” ог (taking the ob- 
tained Score as an estimate of the true score), 

‘This individual’s score lies within plus or min- 
us one standard error of his observed score, 


and we shall be correct in this i 
out of 100 cases, ” муу 


Accepting this fre 
ity, it appears possil 
probability stateme 
dividuals, or a gro 
of the statement is 
ample, 


e" (11. 
the case of true Scores “АП, E а 


i ha given opta: 
score, in repeated testi š ained 
will almost certainly fall wien апей Scores 
ard errors (‘reasonable limits?) саз sand- 

e cor- 
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responding true score. (4) For a group of indi- 
viduals with a given observed score, in repeat- 
ed testing a specified proportion of the obtained 
scores will fall within given tolerance li ЭГ 
with a specified probability, і. е., in a specifie 
proportion of the samples of equivalent tests. 


Summary 


A survey of a number of standard texts in | 
statistics indicated some disagreement in the ын 
terpretation of the standard error of measure t- 
ment. Representative interpretations were il 
ed and classified under several types. Two а 
types of difficulty appear in interpreting t Б 
standard error of measurement. The first сол 
cerns the problem of making statements 1d 
cerning true scores on the basis of the stan a= 
error of observed scores. Guilford and Linc” а 
quist prefer to make interpretations only in ен 
of the distribution of obtained scores іп три, 
testing, or of the distribution of the obser Ys. 
Scores of individuals with a given (assumed) ake 
Score, On the other hand, various writers P" 
Statements concerning the true score on іне ш» 
is of an observed score and its standard pow 
They do this by implicitly or explicitly taki dis 
the observed score as the estimate of the e 
score, and using the standard error of the ^». 
served score as being equivalent to the stan ого 
error ofa true score. While the observed Sra 
is an estimate of the true score, itis по esti- 
true score, nor is it necessarily the best + this 
mate of the true score. It would арреат ^" rio, 
type of interpretation is therefore Ceara vid" 
Statements concerning the true scores ре разе 
uals with a given observed score shoul error 
on the regressed score and its standard 


4 1 118 
of estimate. While the effort involved in Le 


ic 

ited to such regressed scores. Rigorous 16 
Would indicate, therefore, that statem d Lind" 
Should be of the type given by Guilford d scor 
quist, Nevertheless, use of the observe on 
as the estimate of the true score is Па geni” 
accepted, and appropriate statements со туе 
ing Ше true scores of individuals with а в ше 
Observed score taken as evidence of the 
Score are given. Ñ 

A type of interpretation which makes eat 
ments about the group of individuals with 4 б 
en observed score was mentioned. No sumt i- 
ехасі statement сап be made about all the ан of 
viduals with a given observed score. li^ 
exact probability statement based on the арй, 
cation of tolerance limits has been sugges 


16 
е ie that the confidence interval computed from repeated d 
Proportion of cases specified by the confidence 006 


Магеһ, 1955) 


e problem is of little practical interest, how- 
maki; since we are usually not interested in 
witha’, statements about groups of individuals 

а given observed score. 
of Да second main difficulty concerns the type 
ще tement which сап be made. Probability 
applies to the statement, which is true in a giv- 
parameter a of cases, and not to the score or 
is not d which is fixed, i.e., it either is or 
сазе а the stated limits ша particular 
probabili cannot be stated, therefore, that the 
гие ved > two-thirds that a given individual's 
ard erro em within plus or minus one stand- 
timate г of his observed score taken as an 65" 
in the s his true score. For all the individuals 

c o distribution, the probability is two-thirds 
One gia ке Scores lie within plus or minus 
it can бе rd error of their observed scores, i. €., 
s cor бе Ptated that «this individual's true 
еггог of чэн within plus or minus one standard 
Corr МБ 1 Observed score", and we shall be 
tribution, in two-thirds of the cases in the dis 
9 == type of statement led to а consideration 
аге я of probability statements which 
Suggested thar” in other interpretations. It is 
0 Probabil” following the frequency theory. 

l score ity, statements concerning an individ- 
applyin ws be of this type, the probability 
Not to Е о Ше truth or falsity of the statement, 
for the m Score. For groups of individuals, OT 
Probabili ibution of scores of an individual, 
fashion ity statements can be made in the usual 

сърца the types of appropriate statements 
Makes it €d. The use of tolerance limits 
ШЕ the ; Possible to make statements concern 
Propor Уа] which will include а зресше 

Toup oe of the scores on repeated tests of a 
to Which individuals with a given observed score, 
ап exact probability сал be assigned. 
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SIMULTANEOUS EXAMINATION AND METHOD 
ANALYSIS BY VARIANCE ALGEBRA 


WILLIAM J. MOONAN* 


U. S. Naval Personnel Research Field Activity 
San Diego, California 


с 

ю бөн ERABLE attention is ойеп біуеп 

be utilized гисНоп of examinations which are to 

PSycholo, i Some respect for educational and 
ese leste al research purposes. Frequently, 

varying co are used in method experiments of 

that ver mplexity. It is a matter of record 

i y little attention is given to the examina- 


lon aft : 
ег or during Ше execution of {һе ехрегі- 


ments, 
quoted se raqnently consistency coefficients are 
mental m data obtained from extra-experi- 


port eid ue but it is more important to re- 
e methods 1 they result from the imposition 
lS is espe S upon the experimental subjects. 
conditions ер АШУ true, И Ше methods impose 
OSe of the o ich are somewhat different from 
Ало original examination standardization. 
9r not any Қ даны matter concerns whether 
Don-additive | а set of items "interact," in the 
n order у ^, Sense, with the different methods. 
F i че out the relevancy to methods 
tonal examp] consider this hypothetical educa- 
to two cla ple. Suppose a 50 item test is given 
Who were ж of equal size of arithmetic students 
the studo, 28At by two ditferent methods. If 
25 items pes of the first class answered the first 
While the соггесйу and missed the last 25 Неше» 
15 type or udents of the second class reverse 
Which are response, then the two sample means 
ОГ the two Calculated from the total test scores 
esis of e &roups would be equal and the hypoth- 
faineq, Quality of the two methods would be 5887 


Gar 
the Ка We would not like to conclude that 
lack ет S of teaching were equivalent since we 
aer 9 Wit Єсєввагу basis for judging the equiva- 

Ct with ‘se test whose items so obviously inter- 

r methods. This may happen on a 
Nees ONSE ale in real educational experiments 
шэг % quently should be guarded against. we 

fecto, 56 ап examination with items which аге 


ед 
m the оу, but do not interact with, the factors 
Woe ineriment, Tests of hypotheses for item" 
Маў егасНопз апа сопзїзїепсу coefficients 


i е 5 
Ments ЭХ Егеа4 value in the analysis of exper 
lizing examination data. 


*Th 
© Opin. 
Cop Pini, 
Эд, e expressed are solely U. 
S representing those of the * 


those of 


+пе author 
5. Naval Perso! 


It is the purpose of this paper to show how 
item-factor interactions may be tested ina 1-fac- 
tor experiment where the variables are obtained 
as a result of an examination score and to evalu- 
ate the internal consistency coefficient and the 
index of internal consistency of the examination. 
The factor will be referred to as “methods” in 
the discussion which follows, These ideas may 
be easily generalized to other designs typically 
used in educational and psychological research. 


The Analysis of Examination Data in a Methods 
pesign 


It is immediately recognizable that the item 
responses оп the examination are not stochasti- 
cally independent for a particular subject who 
participates in either method. We shall make 
the assumption that this dependency is measured 
by р(1) which is Fisher's intra-class correlation 
Thus we may write the expected val- 


coefficient. 
ue of the 
M 
I > S(m)=IS normal variables as 
m-i 
(1) Ey(i, m8) = Фа, m) =Ë + c(i) + (ш) + 96, т) 
where i= 1,...› 1;т=1,..., М,8-1, 
«єє. Bt). 


In this equation, Е represents the general effect, 
L (i), the effect of the ith item; (ш), the effect 
of the mth method; and Ө (i, m), the effect of the 
(i m)th interaction. The model may be герага- 
meterized by the following linear restrictions: 


M I M 
с()-0; A Ph sium Е Өй, та) =0. 


1 


мн 


тһе variance of any observation, y(i,m,s), is 
у[у@, ms 1-92. The following table indicates 
Ц as provides the covariances, C, 


this fact as мес а5 рг 
for various combinations of i,m, and s. Тһе 


primes denote different values of the indices, ex- 


and are in no way official; nor are they to be 
nel Research Unit or Bureau of Personnel. 
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cept where equalities are indicated. Notice that 
Cly(i,m,s), уй, m, s] = p (I)o? and that the var- 
iance, 02, and the covariance, p(I)o?, are as- 
sumed to be equal for all methods. 


We now follow a procedure suggested by Nan- 
di (3.. An orthogonal linear transformation is 
made on the y(i, m, s). The equations of trans- 
formation are: 


h 
@) z(h,m,s)- [hy(h-1, m,s)- 2 y(i,m,s)] / 


Уһ hel; hel,..., TI 
I 
(8) 2(,m,s)=VT y(. sm, в) 2 y(i, m, 8)/ УТ. 
i= 


Hence, the variables 2(1, m, s), z(2, m, s), 
:--» Z(I-1, m, s) are normally and stochastically 


independent, The variance of the variables is 
[ [1 -p(] Since 


h 
(4) V[z(h,m,s)] = (ве У [УЕ а,ә] + v[ > 
і=1 


| h 

yü,m,s)] - гас был, п, в), Z yG, m, 81) 
1=1 

/ hh+l =È [1202] + (ho? + h her p()o*] 


“ЭМрау Иня = ep. 000], and 


С [z(h, m, s), Z(h', m, s)] = 0, 


Also it is easy to Show that y [za m, s)] 
= ЕД > 
=0. Cl Tite. 
sl eos) 1 Ён сыр P is 
cause of the orthogonal LIES bad 
ion, 
Ж М S(m) 1 
5 : 
m-1 851 A ES "epe Ezt, m, s)] 2 


Ш E I 
m=1 551 А DG, m, 3) - Éy(, m 8)] ° 
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We now break up the left side of (5) into two 
parts: 


M S(m) 1-1 | 2 E 
(6) 2, 25 2 [z(i, m, 5) -£zi, m, 5)] tmel 
m-l Б=1 del ~ 


S(m) 2 
z ГЕ, m, s) - 6 2(1, m, s)] 
5- 


Making use of the fact that 


M 

M 5( 2 А 

(7) > ga [z(1, m, s) - Е 2(1, m, s)] Е ES 
m=1 5-1 


S(m) ЕК. 
2 Afy(.,m,s)- E -«(m)] , 
5= 


ing 
we are finally able to discern the followi 
equality 

M 


2 = 


1-1 > Š 
zn ms) 626,80) “де! 
1-1 


М S(m) 
(8) 5 > 
m=1 5-1 
2 
S(m) I +) = Oi m)] 
= > [y(i,m,s)-y(.,m,s)- 40) ын 
5-1 1-1 
jated 
which has 1-18 degrees of freedom asso hus 
with it. The total sum of squares | 5) may P? 
been partitioned into two parts which squares: 
called the “within methods’’ sums 0 amë 
(8), апа the “between methods” = 


қ simil 
This design has features woi frequenti 


For lack of a better name, the mod 
alyzed here might be termed the ^ 
and inter-method linear hypothesis- artition® 
eses of the intra- and inter-method йг, pre? 
tested with different precisions. T and 02 р 
sions are estimates of 02 [1 - p] ade within, 
І-ір(1)| respectively. The tests ™ endent е 
one partition are stochastically indep ti 
the tests made within the other of the а 
Тһе rank, or degrees of freedom’, бов у 
mation space for Ше intra-method р ly in 
ІМ-М since there exists IM-M lineal ВО Оп 
ent interaction parameters, whichper", timati 
the reduction of Ше reparameterize 1) + OG 
space of € (уй, т, ѕ) - у(. , m, $)1 = 
by elementary transformations. < gr 
the error sums of squares for this Des рурд" өв 
given by I-IS - IM-M -1-1 5-М. P z 
eses c(i) = 0 ала Ө(і,ш) =Oyieldsum” 5 
Whichcaneasily be shown to have Fla 
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degrees of freedom associated with them. 
eee of the estimation space for the in- 
дим: hod partition is М and the rank for the 
тог sums of squares is S-M. The hypotheses 
1 2500 and да) - 0 have sums of squares with 
hase ы degrees of freedom. As a result of 
Ne cub servations and some further algebra, 
With үе analysis of variance given by Table I. 
the entri e aid of the statistics calculated for 
Taole I с" іп the sums of squares column of 
eses да possible to test the various hypoth- 
clude th d їп the first column. These tests in- 
which ден esired item-method interaction test 
SS (| : obtained by using the mean squares of 
of fre па 58 (81 as an Е ratio with the degrees 
edom (1)-I-1 M-i ава (2)=1-1 87M. 


that is, 1 M-i, I-I S-M;1 - c]. 


Consi А 


Sistency 


of т TED Бе concerned with a measure 

correlation а consistency or the intra-class 
150 we ion, (I), of the responses to the litems. 

Ой) whi shall define and estimate a function of 

tenc ch is called the index of internal consis- 

"4 pH). 
Эс үл 2), was among the first to define 
S detalle consistency measure which 
y variance algebra. In terms of 


е notati 
the da used here, the parametric value of 


an 
wa 


(10 
) e(8) = 1 - v[z, 1, )] /V[z( 1 9)] - 


In š 
"Эх 98 (10), V[z(i,1,s)] is the variance 
With the цолын effects which are not identified 
istration to 05 of the examination or its admin" 
lance, а, О the subjects—that is, cerror” var- 
хэд wit * vea, 1, 5)] 15 Ше уагїапсе associ- 
the exa. the scores of subjects who have taken 
са аа Specified by the conditions ident- 
nearly e € number 1. Thus, if у[2(%, 1,5) 
қатпа Бе сең via, 1, в)! , then the index of 187 
в “ӨӨ ney is small. This means that 
Posed or. associated with individual scores, 
ative to үр 31 responses to I items, is large ге!- 
the ежа the “error” variance. In other words, 
individuals ОП does not discriminate between 
idence i S very well. As a consequence, con- 
"elatiy oe for individual scores would be 
is 1 ge. 
owen оромат to realize the distinction be- 
с Ariane ала p(H). Тһе parameter; р(1), нэ 
is S of t е property of the responses to the 1 
on ша е examination. The parameter: р(®), 
men с ех of a relative precision property 9 a 
he ге Отрозед by a simple linear function о 
Single aqu Ses to the е tion items within a 
Sub; 2dmini examination item? "each 
“Әсер ив гайол of the examination 2 
If the examination i$ administered sev 
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e 


eral times to the same subjects, а derivation 
similar to the one shown earlier inthis paper 
leads to the evaluation of another covariance 
property of the scores which is knownas the co- 
efficient external consistency. This value is 
often termed the “reliability” of the examina- 
tion. 
The expressions Ү(20,1,5)| and V [z(L, 1, s)] 
are merely special cases of o? [IS] and o° [S] 
of Table I where we consider only a single meth- 
od (M-1) or a particular set of conditions —ex- 
perimental or otherwise. Of course, in this 
case, нім] апа н[м] аге not tested since по 
degrees of freedom exist for the tests. Thus 
the procedure given by Hoyt (ref. 2) is a special 
case of this analysis. 

From Table I, 


vea Ls] = 1-9°[1-©()] 


(11) ©(Н)=1- У[2(,1,5)] c? (141-10(1) 
_ 100) 
1-1-100) ` 


It is easy to see that the index of internal 
consistency, p(H), 15а directly proportional 
function of 0(). Therefore, for a fixed I, ав 
o) increases; 50 does о(Н), and inversely. If 
we express оё [5] as а function of o(H) rather 


than ea we have 
a2 о? [8] = 169 /П- #1068] . 


Егот equation (11), which has the sameform 
as the famous Spearman-Brown prophecy form- 
ula, we learn that the index of internal consis~ 
tency increases as the examination length in- 
An increase of the number of covari- 


creases. ) 
ately consistent items would no doubt increase 
iability between subjects. This is shown 


rial 

by e? [S] =o? [1 + 1-1 ©(1)]. However, ће er- 
ror variance, 0° Ds] ch -0(1)], is invariant 
to the number of such items. Also, o? [15] =0° 
[s] (1 -о(н)) , which can be shown by simple 

15е Thus we cannot increase the absolute 
ociated with the errors of meas- 
t by increasing the examination length, 
but the relative precision is increased. The par- 


ameters 0° S] and o° [5], or their estimates, 


are often 
in item Um 
plying tho 
tems, 1. В 
A test of the hypothesis that o(I) = 0, and 
consequently that o(H) = 0, is provided by the 
ratio ss[s] / I-M SS IS] which is distributed 
as F|5-M; ГМ S-M;i-c]. Тһе upper tail 
of the F distribution should contain the critical 


region since if p(I) > 0, the expected value of 


à 


| | 


ТАВЬЕ 1 


OF УАНТАКСЕ FOR THE INTRA- AND INTER-METHOD LINEAR HYPO 
сша WHEN THE VARIABLES ARE EXAMINATION SCORES "ван 


Variation Freedom Sums of Squares Expected Mean — 


н] : ¿G) = O 
н Гм]: бб, т) = 0 гі м-і ss [15] = B-A-C:G 
E [18] 1-1 S-M 55 [5] = T-B-D+C ог [15] = ог [1 - pw] 


— DE — 


Intra-Methods "M 


Total ІСІ s ss [TwM] = Т-р 
н [о] :§ = § (o) 1 ss [] = 18 [.,.,.)-€(0)]° 
н [M] :м(т)=0 M-1 55 [м] -с-с 
Е [$] 8-М ss [sS] -р-с 0251 = ог [+I poa) 
Inter-Methods 
Total S ss [TBM] = D 
Grand Total IS ss [T] =T 
eee 
where, 

A= 5[5 Z yGü,m,s)] /s D= E Z[Z y(ü,m,s)] /1 

i ms ms i 
в-2 zb y, m, s)| /S(m) G= [2 ® ум, s] 
C= ЕЕ Е уб, аў Asm) тер Z Е Гуф, в) 


982 


кошуопая тузмамнчзаха JO тумнпог 


gz ТОЛ) 


March, 1955) 


pk sa кше of SS[S] is greater than the ex- 
saab ue of the mean square of Ss[IS]. The 
ране hypothesis 0(1) < 0 is not of much 
consa o. importance because 02 [5] > 0 and 
күрү ан e(D > - 1/I-1. The (1 - a)% con- 
the Шэн erval for p(I) may be obtained from 
the va 5510п given in (13) wherein F [o] is 
/ MS ЇЕ ot the observed mean squares, Ms[s] 
and РТЫ FEM, ГА EM; 1-60] 
d d L]-i/r[S-M Т1, 8-M; 1 - о /2 
es obtained from a variance ratio table. 


F[o] - F [0] 


(13) Flo] - е, 
T1 ЕГО +Е [0] 


БАШЫ >р()» 


(13) point estimate for o(I) can be obtainedfrom 

Of the 115128 either the left or right hand side 

to 1, хашин and setting F[L] or Е [0] equal 

in (14), “ариг interval for p(H) is shown 

Setting F € point estimate of p(H) is found by 
[u] or F[L] equal to 1. 


04) 1-F[u] / Ffo] > ea)» 1-F[L] ИЕ]. 


It is 4 

Partition pes possible, and often desirable, to 
Brees огг ach of the sums of squares and de- 
these, wa of Table I into M parts. From 
(m)] бад be and estimates of | (юу алар |Н 

їе estimate made. И we call r[H(m)] the sam- 
or the mth i of the index of internal consistency 
the weight method, then p(H), the total index 15 
аге the 9 average of the r[H(m)]. re 


Before ere of squares for the errors, E[IS(m)]. 


Table у © tests are carried out by means of 


ет its 
9? fisa it is advisable to ch к 
| eck the hypothese 
Using t] = ог [IS(m')] and o [S(m)] = 0° [Sm 
5 geneity of variance tests. 


Samary 


Starti 
tel Of an оо гота the definition of the linear mo- 
ш Administ ат ЧОП obtained as the result of 
ation of an examination in a simple 


MOONAN 
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experimental situation, an analysis of variance 
was obtained whereby tests of hypotheses asso- 
ciated with methods, items, inter-method inter- 
actions and the general mean were made. Fur- 
thermore, point estimates and confidence inter- 
vals were shown for statistics which estimate 


the: 


a. internal consistency —the intra-class 
correlation of the responses to the 
items of the examination, 


b. index of internal consistency—a meas- 
ure of the relative precision of a score 
which is formed by a linear function of 
the responses to the items of the exam- 


ination. 


The evaluation of the internal consistency of 
an examination is important for comparison and 
item construction purposes. The index of intern- 
al consistency provides a convenient measure of 
the relative precision of the error and subject 
variances of the examination. The derivation 
nthis paper is easily extended to other 


iven i 
5 tal designs. 


common experimen 
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CLASSIFICATION BY MULTIVARIATE ANALY- 
SIS WITH OBJECTIVES OF MINIMIZING 


. RISK, MINIMIZIN 
AND MINIMIZIN 
OF MISCLAS 


G MAXIMUM RISK, 
G PROBABILITY 
SIFICATION 


M. CLEMENS JOHNSON 
University of Minnesota 


P 


ые 
inciples for Classification 


Nene PURPOSE of this study is to 
the Неја СЕ ilustrate certain developments in 
tentially u classificatory analysis whicharepo- 
er nol in education. The problem un- 
measuren eration arises when a number of 
esireq E are made опал individual andit is 
ёга cate, b assify the individual into one ofsev- 
ments, R ries on the basis of these meas ur e- 
бео pipi e штей that the individual has 
and that eran drawn from one of the populations 
distributio each population there is a probability 
In БЕСШ of the measurements. 

e observed th. of this type itfrequently may 
ecisions а that the consequences of wrong 
Unique is a not equally undesirable. Somewhat 
Specify the | assumption that it is possible to 

Cision or 055 of utility resulting from a wrong 
thought or misclassification. Loss may be 

- Of as the penalty paid by the statistician 


у 15 TAE : 
tion it s= uess is incorrect. In this investiga" 
the Poss уез to differentiate the seriousness of 


, By dee errors of classification. 
ны Шави а of committing a certain error 
error р ЧОП is meant the probability of that 
thus сорт Чриеа by ће corresponding 1055. Risk 
loss or t sponds to the expected value of the 
is of Boris expected disutility in the long-r un 
Це Prob] le classification rule. In considering 
of Sever em of Classifying an individualinto one 
84 loss bs Populations there is a risk or expect 
i сазан „ед with each possible choice 
‚АЩ 10п. 
tica Po" Unt in the solution of problems of class- 


n 
Values Te the a priori probabilities whose 


£z. 
Фо 


uda Postulate the respective chances 
tion an individual from each of the эй 


5 
„Мен еони consideration. The criteri 
р ith c sification rules are chosen Va rie? 
v Obabi ~ Presence or absence of the a priori 
ules apaes, If they are assumed to be known, 
© Selected which minimize overall risk 


XS 
Pro of : 
fesso. op Published doctoral disse Las 


Education, University 9 


University of 


of misclassification. If ina particular problen. 
it is not possible or appropriate to estimatea 
ri probabilities, the solution requires а dif- 
nt criterion of goodness. Under such condi- 
ssible to choose classificationrules 


prio 
fere 
tions it is ро: 
which minimize the maximum risk of misclassi- 
fication. This is a conservative approach and 
represents an application of the minimax princi- 
le. 
Р Anderson (1) discusses thesecriteria in detail. 
Rao (6), Brown (2), and Welch (9) are useful ref- 
erences. More formalreasoning is gener- 
ally expressed as follows: Assume, for exam - 
ple, that an individual I with the set of measure- 
ments xi... Ха has been randomly drawn 
from one of two populations II, or IL, with prob- 
ability distributions of the measurements fixi, 
ШИН” and f, (Хү,...- „ а), respectively. Тһе 
choice of а classification rule R corresponds 
to a division of the q-dimensional sample space 
into two regions R, and Rz. If the random point 
corresponding to the individual falls in R y the: de- 
cision iS made that Iis from П,, and if the point 


falls in R, the decision is made that I is from 


~ ‘Let L(2/1) be the loss incurred in classifying 
I into H> when in fact I belongs to I, and 
let L(1/2) be the loss incurred in classifying I 
into Il; when in fact I belongs to IL; - For any 
le R let r,(R) be the conditional risk or ex- 
nected loss when I belongs to П,. Itis defined 
Эн {һе probability of I falling in R; multiplied 
by the 1055 associated with this mistake. Simi- 
larly, let г. (В) be the conditional risk when I 
+ longs to I. It is defined as the probability 
E falling in R, multiplied by the corresponding 
u— spose there exist a priori probabilities that 
1 comes from the two populations, say probabil- 
t I does in fact belong to I, and prob 


ity Pi tha id 
ability ра that I belongs to Па, where p, + Pe = 


Minnesota 195h. Advisor: Palmer Os Johnson; 
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= 1. It is then possible to define an unconditional 
risk for any classification rule R as equal to p, 
г. (В) + Рога (ЕК). The objective is tofindthe re- 
gions R, and R; which minimize this risk. 

In other problems nothing may be known 
about the probabilities p, and p, of drawing from 
the two populations. Here the unconditional risk 
cannot. be defined and it is necessary toconsider 
the risk r,(R) when I is from II, , and г. (В) 
when I is from П,. It can be Shown that the 
minimax requirement will be satisfied when ті 
(В) = гг (В). 


Multivariate Normal Solutions 


Of special interest in application are solu- 
tions for the multivariate normal сазе. Anderson 
(1) treats these solutions and his results are pre- 
sented here without accompanying mathematical 
arguments. For two populations, let нов 
have multivariate normal distributions with means 
in П, = ui and in II, = uj, i> i,....,q. Assume 
the two distributions have common variances and 
correlations, The regions for minimum riskare 


defined by the following discriminant func tions 
or classification rules: 


q q 
Ri: Ag -1⁄2 2 a; (uj + uj ) 7 log k 
1-1 1=1 
4 4 1 2 
В; js Хх, - k х (uj + uj) Z log k 
= iz 
where X,,.... 9а is the solution of 
g 
rig. 7jPijM = щі - uf and 


If = 
toe ЖЛ, Ра Which is the sol- 
tion. If a priori probabili 348 а БЕДЕН сд 


ities are not Specified, 


З О that the гіс 

is from 1 15 equalt 1 spri 
© the risk wh i 

p 4 en Iis fro 

ба he solution employs th ° 


е univariate normal 


ее gro 5 
it is necessary to assume a = и аге considered 
classification, qual costs of mis - 
Assumptions 


Of basic importance is 
the assum, 
рЧоп that it 


Illustrative Problem 


(Vol. 23 


ical уа1- 
is possible to assign a comparable numerica 


ue to each of the losses incurred НИИ 
tion. While presently this assumption = “тоа 
if not impossible to satisfy with rigor, 1 | costs 
be noted that the usual assumption of equa Шу 
of misclassification is often unrealistic. 0 у proa- 
measurement is an important contemporar iiu 
lem in the economic field. The reader 15 “ОШО 
red to Friedman and Savage (4) for one ips eg 
the historical background of utility и 
Ап undecided issue appears to be еше и 
(or disutility) is actually measurable ко ой 
any choice among alternatives depends белсе 
their ordering. Coombs (3) in the iae 
suggested the use of a scale not invo:v ~ 
measurement designed to order the Ee 
the interval between objects. The 5 (Т) andfell 
addition to the types set up by Stevens q the ord 
logically between the interval scale an 
nal scale. jeter 
It is assumed in the model that the omm 
values in the multivariate normal sates in prac” 
are known exactly. This is seldom же Ander” 
tical applications. Although Wald (Вы 5 
воп(1) have developed classification ранее 
which employ sample estimates for өйт! ria 
values in problems involving two ші тег 144808 je 
normal populations with the same с, unsui b 
matrix, the distributions are presently 


155 
A nsis 
M оп соры. 
Гог practical изе. А reasonable soluti b 


5 
timates апе орг 


taining the classification rules. с ет" 
large samples it is possible to pem unknown 
parameters were known though son 

ror is thereby introduced. 


у of М 
The General College of the University rs wh 
nesota maintains a staff of trained со individ ss 
devote their time primarily to дер со Е оп 
Students. А principal function of tl the sele? 
is to assist first quarter students in ода] goal 
and planning of an appropriate educ® n t 0 cone” 
In this selection process it is ИП dent with Ft 
sider the capabilities of the new 5 ollege 5 зе 
врес! to other groups of General po је tho 
Do his capabilities most nearly 790] colleges e r e 
Students who drop out of the Gener руа not ti 
dents who are accepted for transfer, who юэ in 
college of the University, or studen associ i in 
in the General College to receive о е 
arts degree? These are Ше groups e 
classification. ily made рой 

Recommendations are сив{отат = ple 
judgmental basis using information Du и 
counselor and the beginning studen отрове а 
measures frequently used for this rp" the AP оп, 
high school percentile rank, шин gxami 
Council on Education Psychologica 


Магсһ, 1955) 


е pemp Cooperative English Test, and 
eneral С йг Comprehensive Examinationof the 
ployed рр Эхэ? These are the variables em- 
Itiwae йны iblishing the classification rules. 
this ны desirable in the design of 
groups on nup to provide for comparable 
and cross Which to establish classification rules 
Selecting Е the results. This was done by 
ting шоо half of all students matricu- 
quarters of eee College during the fall 
Students деп 949 and 1950. Within each half 
assumed to ее by population restrictions were 
Populations pie s of their respective 
Were 273 fo; қынды sizes in Ше main analysis 
uate groy r the drop out group, 76 for the grad- 
р1е Sizes ала 79 for the transfer group. Sam- 
the drop Les in eross validation were 264 for 
and 88 г ut group, 75 for the graduate group; 
or the transfer group. 

C ҮЕ: 
У.йваШсанол Into One of Two Groups 
Applicat; 
classify опа were made to the problem of 
(a) studera adone into one of two categories: 
another coll who were accepted for transfer by 
graduate f... Of the University and did not 
dents who rom the General College and (b) stu- 

Similar м raduated from the General College. 
Е two ditt ication rules were established ue" 
сп Уав бы се Sets of variables. The duplica- 
егеп conditic to examine the models under dif- 
Variables 1015 Of application. For each set of 
Ponding to ба? Solutions were obtained corres- 
minimizing = Owing standards of goodness: 
inc imum tisk of misclassification, minimizing 
{ е Probabili of misclassification, and minimiz- 
з Ше two ity of misclassification. Mean values 
8 follows groups on four selected variables were 


Transfer Graduate 
AC II, Il; 
- 94. 16 87. 83 
HSR* 167.38 162. 62 
Comp 4.51 4.41 
ü 60.28 53.43 


*profit values 


The 
dis 
5 Pers; Š 
hown b TSion matrix bas n the two groups 15 
elow. ed о Е 


248 
251.49. 251.30 106 110.19 
113 930.73 1.90 167. 45 
toyo 1.90 .39 1.46 
The ` 167.45 1.46 216.47 
or ‚Тер 
diser 5 Were defined by the following rules 
Ru ieee functions: 
2. gon! ~ . 0046Х2 + .1494X3 + ‚0241Х4 7 
Ж, logek ' 
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Rg : .0185X4 - .0046X» + .1494Х, + .0247Х, = 
2.995 и logek 


where values of К were chosen according to Ше 
described criteria of goodness. 


Approximations of losses due to misclassifi- 
cation were obtained from three experienced 
counselors in the General College. Since the 
counselors were not in agreement, a median 
judgment was employed in the analysis where 
disutility in misclassifying transfers = За nd 
disutility in mis classifying graduates = 2. 
Values assumed for the а priori probabilities 
were based on the relative frequencies of the two 
groups. These values were .51 and . 49 fortrans- 
fers and graduates, respectively. Subsequently, 
the solution of minimum risk correctly classified 
a large majority of students actually belonging to 
the transfer group, whereas the same solution 
misclassified an equally large majority of stu- 
dents belonging to the graduate group. The tend- 
ency to classify most people аз transfers Was pro- 
nounced since the difference between groups Was 
not very large while the difference in disutilities 
was comparatively great. A similar pattern 
should result if a counselor were to employ the 


same variables under à criterion of minimum 


risk. А | А : 
The solution in which maximum risk of mis- 
classification was minimized produced classifi- 
cation frequencies which were intermediate to 
the other solutions. This rule 


those obtained by 
was not as efficient in reducing overall risk since 
it was pased on a lesser amount of information, 


the a priori probabilities of drawing 
the two populations. In terms of overall 
bis { correct classifications the “best” so~ 
‘on was that in which probability of misclass- 
ar was minimized. This solution assumed 
equal costs of misclassification and, consequent- 
5 represented a different criterion of goodness. 
Tables 1, IL and Ш present the results of the 
cross validation studies for the various classifi- 


cation rules. 


Classification Into One of Three Groups 


In the three group solutions it was necessary 
for purposes of technical simplification to а5- 
sume equal costs of misclassification, This es^ 
5 entially meant that classification rules were 
chosen ой the basis of probabilities of misclass- 
ification rather than risks of misclassification. 
Another distinguishing feature of the three group 
solution was the use of the bivariate normal table 
(5) to obtain the minimax solution. 

Students were assigned to one of three groups: 
(а) transfer, (b) graduate, and (c) drop out. бер” 
arate rules were established with objectives of 

minimizing probability of misclassification and 
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TABLEI 


CLASSIFICATION BY SOLUTION OF MINIMUM RISK 


Probabilities of 


True Predicted Category Misclassification 
Category Transfer Graduate Total Empirical Predicted 
Transfer 18 15 88 414 . 14 
Graduate 63 12 75 ‚84 . 71 
— Mi НЕ ср E. и Чё a ee 
Total 136 27 163 50 42 


TABLE II 


CLASSIFICATION BY MINIMIZING THE MAXIMUM 
RISK OF MISCLASSIFICATION 


Probabilities of 


True Predicted Category Misclassification  . 
Category | Transfer ^ Graduate Total Empirical Predicted 
Transfer 54 34 88 .39 .32 
Graduate 46 29 15 .61 .48 
м м ә м” 


TABLE HI 


CLASSIFICATION BY SOLUTION OF MINIMUM PROBABILITY 
OF MISCLASSIFICATION 


e 


True Probabilities of 


Predicted Cate i ification 
Cate ее vategory 0. Misclassification - 
gory Transfer Graduate Total Empirical Predicted 
Transfer 50 98 ШЕ m aT 
Graduate 37 38 75 | 49 42 


Total 87 
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TABLE IV 


SOLUTION OF MINIMUM PROBABILITY 


CLASSIFICATION sy 
F MISCLASSIFICATION 


Probabilities of 


ёл че predicted Categor Misclassification 
or Transfer Graduate Drop Out Total Empirical Predicted 
кыы 15 0 30 45 . 66 .19 
Dr uate 3 0 31 34 1. 00 .99 
op Out 4 0 117 121 .03 .04 
Total 22 0 178 200 .32 .35 
TABLE V 


CLASSIFICATION BY MINIM G THE MAXIMUM PROBABILITY 
12 ASSIFICATION 


— == 
Misclassification 
Empirical Predicted 


Trans 
с fer 20 19 34 .38 
21 121 „53 „55 


raduate 7 
Drop Ош 14 50 57 
69 200 


Total 4l 90 
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mininiizing maximum probability of misclassifi- 
cation. Customarily, only one standard of good- 
ness would be adopted depending upon the pres- 
ence or absence of a priori probabilities of draw- 
ing from the three populations. In this example 
probability of drawing from the transfer group = 
.18, from the graduate group = .18, and from 
the drop out group = . 64. 

In the solution of minimum probability of mis- 
classification most students in the cross valida- 
tion groups were assigned to the drop out cate- 
gory. This was because differences between 
groups were not very great, while differences 
between a priori probabilities were comparative- 
ly large. When probabilities were not assumeda 
solution was obtained which minimized the max- 
imum probability of misclassification. Although 
not as efficient in terms of overall number of cor- 

ect classifications, the minimax solution classi- 
fied students in a more normal fashion. Tables 

IV and V summarize the cross validation results 
for the three group solutions based on a sample 

of 200 students drawn at random from all valida- 
tion groups. 


Summary 


This investigation had its setting in the Gen- 
eral College of the University of Minnesota and 
illustrated the classification of students into ed- 
ucational groups on the basis of measures com- 
monly used for counseling purposes. The groups 
were assumed to represent multivariate normal 
populations with the same set of variances and 
correlations. Comparable samples were obtain- 
ed on which to establish classification rules and 
cross validate results. This was done by select- 
ing a random half of all students matriculating in 


the General College during the fal 
1949 and 1950. ш ман 


{ еггог inh 
corresponding loss, multiplied by the 
rule was chosen varied wi 


(vol. 23 


which minimized ris.. ої misclassification. i 
suming it was not possible or appropriate to as 
sign a priori probabilities, а rule was chosen | 
which minimized the maximum risk of mia 
fication. When three groups were involved s 
necessary to assume equal costs of misclassH! 
cation. 

The techniques are applicable in theory to 
most classification problems. They should Бе 
useful, for example, in making decisions 01 я 
whether to admit or refuse to admit puer pt 
college. While a rigorous determination of ШИ, 
values remains a serious obstacle, an арго 
mated value may sometimes be more realisti 
than the assumption of no differences. 
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THE POISSON DISTRIBUTION IN 
EDUCATIONAL RESEARCH 


SAM DUKER 
Brooklyn College 


ED 
fines PUR research in many in- 
ple and the ists of gathering data about а sam- 
to the po n generalizing the resulting findings 
lected, p from which the sample was зе- 
Only if, fir esee thus made are valid 
апа а , the sample is properly selected, 
are employ, Lag ram statistical techniques 
involyed = - The interesting and often quite 
Sampling UM involved in the process of 
ere only ба not within the scope of this paper. 
У means of phase of the statistical proc ess 
defined ро which inferences are made about a 
Collected esta on the basis of data whichare 
ава а population 18 
Funda 
drawn ялыг! such inferences can only be 
»y the variable: Shape of the distribution formed 
їз ару h es making up the population canbe 
еге has рое пей, Ineducationalresearch 
tall жатын а noticeable tendency to assume 
зПаред irea aliens are of the normal or bell- 
vays justified уре. This assumption is not а1- 
Onvenient зы, The normal distribution isavery 
т tatistical model; it is neatly SY" 


etric. 

al and 

"à real Situatio ean, mode and median coincide. 
es ons we seldom find such neat Sym" 


Ty nor k 
2 n, pde un find many cases where t he 
ic in по w nd median coincide. These stat- 
со, сопсері m depreciate the importance 01 
nerd ls an the normal distribution for this 
6 in edu extremely important and u$ eful 
Cational research. 


he 
th п the 
to ubOpulat Shape of the distribution followed by 


techni аре not known it becomes necessary 
of i ues о ic statistical devices. SUC 
т Че intei е en regardless of the Shape 
ble „оте ace ion and are therefore highly 989” 
Can OWeve urate and usable results are possi" 
be T, when the shape of the distribution 


disc del 
Stribution, Curiously enough, Ше eX” 


Cha by Авсан distribution was first noted in 
Who ees. TUN de Moivre in his Doctrine 9 
Prong it is a and later by the man aiter 
lig! mate a: „Simeon Denis Poisson, 2 
lent; Who танстал who lived from 1781 to 
bution? deve Was a man of rare diversity of 
Of the in 182 loped a derivation for this distri- 
8 laws 0 (2) in a work on the application 
9f probability to the determination 


of the likelihood of miscarriages of justice in 
courts of law. Since that time this distribution 
has been independently derived by a number of 
other investigators. The Poisson distribution 
may be derived either as à limit of the binomial 
distribution ог а5 an independent distribution of 
randomly distributed rare events. 

The Poisson distribution is à discrete func- 
tion which exists only for positive integra 1 
values of the variate. When the mean isless 
the probability polygon is J- 
shaped. When the mean i$ greater than one it 
becomes double sided and for larger values of 
the mean tends toward symmetry. This is an- 
saying that when the mean is less 
than one, the mode is zero. When the meanis 
greater than one, but not an integer, the mode 
is the nearest integer less than the mean. When 
the mean 15 21 integer greater than or equal to 
one the probability polygon is bimodal, the 
modes being the mean and the integer immedi- 


ately below the mean. 


standard deviation toge 
tribution, for knowledge of the mean enables 
one 10 determine the distribution and all its 
:sson distribution is rarely employed 
in educational research. The ever increasing 
use of statistical techniques in educational 
researc makes it important that other than 
normal distributions be employed where neces" 
ot all non-normal distributions will 
follow the Poisson law, but, when the assump” 
tions underlying the Poisson distribution appear 
et, the hypothesis that the data may be 


the ue 
pe natever its form may be. 
may be expected to fall into the form of 


isson distribution only when certainbasic 


о 
the орнола are met. These assumptions are 
five тп ber. 


iscreteness. The data involved must 


1. 
be discrete rather than continuous. The event, 
the occurrence of which constitutes the data, 


must be of the type which either occurs ог does 


266 a 


not occur. It is ап “аП or none" proposition. 
Scores obtained from measurements yielding 
fractional or negative values cannot, therefore, 
under any circumstances, be said to constitute 
data subject to the Poisson law. 

2. Possibility of large number of occur- 
rences of the event. The possible number of oc- 
currences of the events at any particular oppor- 
tunity must theoretically be infinite. In practice, 
of course, such data are not to be expected. It is 
essential, however, that in such specified divi- 
Sion of time, space or other unit, there must ex- 
ist a possibility of a large number of occurrences 
of the event, the frequency of the occurences of 
which constitutes the variable making up the dis- 
tribution in question. This requirement must not 
be confused with a statement concerning the size 
of the sample under consideration. The size of 
the sample could not influence the, nature of the 

population from which the sample is drawn. If, 
however, the sample is small the form of the pop- 
ulation distribution cannot be determined with 
much confidence. 

When the possible number of occurrences is 
Small, a distribution is often observed to have 
frequencies conforming closely to the theoretical 
frequencies for Zero, one and two. Тпе hypothe- 
515 that the Poisson distribution is present must 
be rejected in such cases, as it must inall 
cases where the basic assumptions are not met. 

3. Small likelihood of the event occurringat 
апу particular opportunity, The hypothesis that 
а Poisson distribution is present cannot be ac- 


cepted unless the probability that the event will 
осешг at any one 


The requirement 


the pres 


4. Equality of o ortuni 
A 1 
тһе specified divisions of ti ү Ог оссиггепсе. 


1 urrence 
being observed, It Would not be Wess ээний 


words, where the гонан" Sion, 
of ап event varies from divisio, 
whether such division р го 4 
other unit, the Poisson distributer” place, or 
used as a model for the empirical аав 204 Ве 
оп. 
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Sometimes a compound Poisson distribution 
may occur in such cases. 

5. Independence. The occurrences of d 
event must be independent, that is to say, 2«: t 
occurrences of an event at one opportunity pem 
have no effect on the probability of a веб! o 
currence of the event at the same opportuni 279 
and b. Ше occurrence of Ше event at one E 
tunity must have no effect on the probabili БЕ 
an occurrence of Ше event at another oppor 
ity. 

rt assumption of independence is of . 
importance in determining the propriety iiu » 
cepting a hypothesis that the Poisson dis s 
tion is present. It is essential that the о [тс 
гепсе of that event at that same time ог Е til. 
or at another time or place. Many ag D 
data seem to conform to the Poisson 19 5 
tion in all other respects such as equali y served 
mean and variance, correspondence P. the 
and theoretical Poisson frequencies а meet 
meeting of allotherassuniptions, but fai 
this requirement. 

There are, for example, severa ducation in 
having to do with new processes in ecu f the fre” 
which at first glance the distributions cod appear 
quency of adoption oí such new peni 
to follow the Poisson law. Careful мин 
however, reveals that the adoption ed o influ” 
process in one situation may well ten nereíore 
ence its adoption in another and that, t 
the requirement of independence 15 n i hypo” 
Under such circumstances accepting e re^ 
thesis that the Poisson distribution = 
garded as a model would be erronea ill be 

In general, the Poisson distribu tion 18 
found only in cases where the distri arily " 
highly skewed, but this is not neces son distri 
ways so. As already noted, the рб x meani’ 
bution tends toward symmetry when 


1 situations 


large. and v2 г , 
In a Poisson distribution the pourra of me? 


ance are equal. While the near e cation ШЕ, 
and variance certainly is a rough ‚ Poisson аг 
the possibility of the presence of а is not 25", 
tribution should be investigated, it ahi Sub. 
ficient basis for assuming the prese es ne” 
a distribution. Distributions with a et th 
ly equal mean and variance may fa dist урш, 
assumptions underlying Ше pom distr iP, 
ТА such cases the hypothesis that d ecte р” 
tion is followed by the data must be ау ога 
even when the observed frequencies =. poiss? 
proach the tabulated frequencies of қ 
distribution. са”, 

It is important to know that ап стари рої? 
distribution of educational data follow® |) (te 
son law because with such knowledge ® re ро? 
analysis and understanding of Ше da ate th „д 
Sible, First, it is possible to estim? ^ curri 
liklihood of an event occurring or not 


March 
, 1955) DUKER тэ 


үер accuracy because of Ше availability Singh (12) found that the daily number of ticket- 

is vital ЊЕ the Poisson distribution. Second, it less passengers traveling on an Indian railway 

kmow &h he use of various statistical tests to were distributed normally but that the number 
e nature of the distribution involved be - who had to be evicted for refusal to pay their 


fare fell into the form of a Poisson distribution. 


са 
Cause such tests are valid only when certain bas- 
The classic example is the one given by Bort- 


ic i 
w assumptions underlying them have been met. 


е basic assumptions for such а test are kewitz (13) who found that the number of menpez 

Phim dr be satisfied by data distributedin a year per Prussian army corps who were killed 

not be n istribution the use of such a test can- by the kick оға horse fell into this form. 
justified. Third, it is important in рег” In conclusion one example of educationaldata 


distributed in accordance with the Poisson law 
will be discussed. 
When a rote task of the sort in which perfect 
mastery is the goal is first introduced to learn- 
robability of errors being made by 


Ormi 

mation analysis of variance, as à transfor- 

Cation of fe. own which makes possible the appli- 

cordance will procedure to data distributed in ас- 
with the Poisson law. It is here that 


е educatio 
со nal research worker is particularly ers, the p ; r y 
Псегпей because ће so frequently on analysis these learners is very large. This probability 
becomes smaller as the stage of perfect mast- 


Of vari; 
: а Е 
псе procedures, Often such an analy 515 


is 
Performed without any examination of the pres~ ery of the rote task is approached. Of course, 


епсе rc à | 
ан 20вепсе of equality of variability in the the possibility of making errors remains equally 
Suc ution of the data being examined. Since large at all stages of the learning process. It is 
unge Йй of variability is а basi¢ assumption also reasonable to conclude that at the beginning 
e co Ying this technique, its absence is fatal to of the instruction, the commission of one error 
tained > сшевв апа validity of the results 007 increases the probability of another error. In 
2 nificar, When a difference is claimed to be sig- typewriting, for example, a beginner hitti и 
| Small 02 non-significant on the basis of a very a wrong key is likely to Бүл Mp sr 22 
failure to piss from a given F-value, such а make other or kaypas deer ert 
i 1 1 5 : B | 
n important а results тау invalidate нет sum io not so likely to make cumulative er- 
Son Л number of instances in which Ше Pois- studer! his is another way of saying ome 
m" eee on has been found to be applicable errors made by advanced learners ar 
т 
Теве У few exa іуеп һеге. inners. Іп this type ing, 
Pronenes: "pee пете io ihe fel of seldent number of nr таа гай 
S 5 НН 1 ег. , 
ef р ТЭМ ihe Polpron distribution to | in another. Ñ made by learners, as Ше stage 
and у any situations го ( » both pedestrian of perfect mastery is qup lie : E 18а 
ие Мещат traffic һа Е СИЕ tlie requirements imposed by 116 сыла“, Te 
Бира Хог (4). Thi P Шық ишлей in underlying the Poisson ВОТ fse concerning — 
light Ing the most ws fact has pen m affic some interesting implica Y s Жа 
и Way aS well as th icient timing of tr thigh а method of measuring the state of g й 
| Stop Signs e most efficient placing 0 5 tained by 2 group being аа E ар Р 
: се 1 = те discussed. When the stribu оп 0 
m manner. ее. phenomena occur in Such n" . takes the form of a Polson Шәт ошон 
radio- C Poisso mesta ie assumptions а it веет reasonable to suggest the hypo esis 
bre О-аснуе di n distribution. A few of them ar и the point has been reached in the learning 
huj ез pr isintegration (5), chromosome ocess where further instruction would yield 
ang ЁТ о Oduced in cells by X-Ray (6), the pr urther gains in learning. Afurther 
nd nuclei i minimal 1 ři š ә 
| Era, th numbe ei of condensation in the air (7), hypothesis that such a distribution would depart 
Phic regi ег of meteoric falls per small g€07 и the Poisson form when instruction and prac- 
ling Quality co (8). tice cease and forgetting sets in, would seem 
Pur control tables for sequential ѕатр- worthy of investigation. The hypothesis that 
deya E ne S are based on this law (9). further practice would then again bring 5 ucha 
Son оре ri field of operations research has been distribution into the shape of the Poisson distri- 
lay (10). large part on the basis of the Pois- Е оп would follow logically if the first two hy- 
| but; Telepho, | ра otheses were found to be tenable. — — 
| у in deis engineers use the Poisson distri РО ne relationship between the distribution of 
| вер боа €rmining the number of cables, errors and the Poisson distribution was first 
| ва i Stations, and so forth пе eded to ointed out by Shuster (14) in his study on the 
| асаа Соц еп amount of traffic (11). Teach of slide rule procedures. Shuster found 
5 umber of errors made by his students 


ati 1 -ед- 
Їе, Чопај 291 i 1 list of non"? 

W l ng this abbreviated lis E that the п 
ода ; tuations involving this distribution, 2 at the end 0 


nces will be given. 


f the experiment were distributed in 


b ПН 
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accordance with the Poisson law. 
With this study as а cue a study was made ог 
the errors made by students of typewriting (15). 
The subjects were students taking first, sec- 
ond, and third semester courses in typewriting ia 
the Commerce Department of а large midwestera 
college. In each of these courses а bi-weekly test 
of constant length was given. The data covered а 
period of three years and included the results of 
nearly 9000 of these bi-weekly tests. An exami- 
nation of the average number of errors made per 
student per test showed that there was little 
change in this respect (the mean varied froma 
high of 8. 98 in the first semester to a low of 6. 29 
in the last test of the third semester), This fact 
is easily accounted for by the increased rates of 
Speed on the part of the more advanced students, 
There was, however, a considerable change in 
the variance which dropped from 36. 47 inthe first 
test of the first semester to 7.15 in the last test 
of the third semester, 

The distribution of errors in the third sem- 
ester showed a clear correspondence to the Pois- 
son distribution and the chi-square test bore out 
this correspondence, 

A specific examination of theassum ptions 
heretofore given as applied to this situation bears 
out the reasonableness of this correspondence be- 


tween the empirical distribution and the theoret- 
ical Poisson distribution. 


2. Possibilit of a la 


obviously met, 
3. Small likelihood of the 

any particular о ortunity. Аз егі 

is approached by the Student тн стави 

error at any part; 

constantly Smaller, 

that the requirement that the оаа, г 


of learning, 

4. Equali of it 
Very little question Could arise 
each of the ma; 


for occurrence, 
to cast doubt on 
present an equa] opp “iy ду items in the test 
of the event we are concerned ee occurrence 


5. Inde enden 
the kinds of errore c Ав ha 


Бе. Тпе Commission = 
of 
student does i ~. 

ably 


У Stages m ау 
ап advanceg 
more likely the 


3. Greenwood, Major and G. Udny Ы 
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commission of another error by him ог by any Я 
other student. The requirement of complete + 
dependence of the events with the cw E 
which the distributions are concerned is, tages 
fore, substantially complied with at laters 
of instruction, 3 
In the light of this examination of the пеш 
in which these distributions meet the sc ape 
sumptions underlying the Poisson distribu ч the 
Would appear reasonable that the cer dn т 
errors made by advanced students woul ile the 
to the form of the Poisson distribution whi 
earlier distributions do not. : in 
А similar study is reported by Davis (16) per 
which he found that data consisting of ie this 
of typing strokes between errors fell into 
form. | distributions 
Many other examples of Poisson dis ld be give? 
in the field of educational research cou = 
if space permitted, пат сате 
While preparing this paper Ше Lie рш" 
across Ше following sentence in an Те teaching 
porting to report an experiment in ы е forma 
of reading: “With no emphasis upon ime ná 
teaching reading whatever, the € 5 па геа4“ 
groups outgained Ше comparison gro зав (9.5 
ing achievement by an almost doen signifi” 
months to 5.8 months) at a statistica t this dis 
cance of less than 1%.’’ It is hoped tha contrib” 
cussion of the Poisson distribution си having 4 
ше to reports of educational цээр” 
Statistical significance of more than 1%. 
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FORECASTING FUTURE ENROL | 
LMENT 
CURVE-FITTING TECHNIQUES _ 


H. P. KUANG* 
University of Minnesota 


w 
еш а relatively little in advance 
plans for the Fi yet we are frequently making 
ог every coll uture, Every university president 
knowing how ege dean is constantly interestedin 
of the facult many dollars, buildings, numbers 
quired to ы ала course offerings would be re- 
Who would ONE instruction for the students 
of years in 5 in attendance in one or іп aseries 
he future, This requires in a high 


egree t 
he forecast of future college enrollment. 


Ther 

ve she à number of approaches which 
School Niel аси to Ше problem of forecasting 
еге involve ment. The approach as discussed 
Curve-fitti S a curve-fitting technique. The 
a functional procedure consists in determining 
years anq Ci ешр which exists be tween 
Projecti : е past enrollment records and then 
Which ie Жыла function to the year or years for 
t this Pei is desired. It should be noted 
plow tera is made on the fundamental 
I eful clue р the historical records provide 
П other word 9 the possible future enrollments. 
enrollment S, it is assumed that the present 
Past y growth is fairly well indicated by 


есог 
recent 10145, and that factors operating in the 


future. 


The 
types Purpose or this paper is to suggest three 


ofc 
ion of 28 by means of which the predic” 


not my 


e 
lem У 


assum, 


ast wi a 
t will continue their influences in the 


шон enrollment might be made. It is 

to e to review all growth curves, but 

estim е a little suggestion on the prob- 
ating uncertain enrollments. 


А.т 
s The 
~> Exponential Curve 


The с 
toe а и function is applicable to the 
te еза define the 
Ч е 1 
y (o орг ыы of t (say, year) are in arithme- 
Sion} enrollm and the corresponding values of 
Ang Чеп bia, are іп geometric progres" 
Abt, 15 зада relation between the variables t 
1 to be an exponential function, у= 


St be ania! St t + 26 ..... ы + (0-1) 

Ml ома netic A en andi eh qu, Хы 557% 
= Ян be a geometric series. Then the 

the arithmetic series is tn = * 


ыг! 
T я autho: 
Short; 


palmer O° 


регі 8150 due to Dean Re Be | 
i + 


of time examining the trend 


T is on, who re 
are grateful to Professor throug! e courtesy 
of the е 


(n-1)4t or n-1= іп и t, . Similarly, the 
^ 
ynth term of the geometric series is yn = rn-ly,, 


шъ sto d 
Hence yn = y r At = уга! (r At) fn 
or ур = abtn 
n (1) 
26 d 
where a=y,r4t and p=r4t 


Since any t is connected with the correspond- 
ing y the equation (1) becomes 


y = abt (2) 
y be fitted readily 
Taking log- 
the equa- 


The exponential curve та; 
by reducing it to logarithmic form. 
arithms of the above expression (2), 


tion becomes 
log y = log a + t log b (3) 


which is а straight-line trend of log values. 
According to the least-square principle we 
esiduals by differentiating 


may minimize the r 
in turn with respect to log а and log b. Wethen 
obtain the solution of the logarithms exponential 


equation (3): 


гхз log y - Dt log y 


юы abt? - Œt)? 


not log y - 22 log y 
- (2 t)? 


log b = PPT 


In case the data are not given with the values 
of the independent variable in arithmetic pro- 
gression it may be readily proved that if the ra- 
tio of the first difference о log y to the first 
difference of t is constant, then the relation be- 
nd y can still be expressed by the same 


tween t а 1 
exponential function (2). 


ad critically the draft of this papere 
the author was permitted to spe a 
a in his office. 


nrollment dat 
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B. The Gompertz Curve 


This curve was first reported іп 1825 in a 
paper read оу Benjamin Gompertz, а Jewish 
statistician who worked with a life insurance 
company in England. The general formula for 
the curve is 1 


а 
уз Фа (4) 


іп which y represents measure of growth at the 
time t; d. сапа а being constants. Essentially 
the Gompertz curve is of the exponential ty pe. 
The exponential function as discussed above is 
a linear trend of log values while the Gompertz 
curve is a linear trend of log log values. To il- 
lustrate this relationship we simply put а = 1 
and take the logarithn: of both sides of the equa- 
tion (4) 
log y = qt log g 
Taking the logarithm again, we have 
log log y = t log а - log log g 


which is the equation of a Straight lineinterms 
of log log values. 

Hence, it is evident that the Gompertz func- 
tion is expression of the nature of enrollment 
growth if the relationship between time and the 
log log values of the enrollment is linear. In 
order to fit the enrollment data to the Gompertz 
Curve, we have to determine the constants d, с 
апа 4. The three constants may be estimated 
from three equally spaced points which are so 
Chosen as to represent the characteristic of the 
data. Let the three points be (Е, yo)(t, + 1, y,) 
(t; +2,у.). Substituting in the equation (4), we 
have the following three equations: 


Уо-а. ваб 
уана. ват! 


Yaad. gatit2 


log d = 4105 yo - log y, 


4-1 


logg- logy, - log yo 
qt(q-1) 
q= log - lo 


C. The Logistic Сигуе 


In 1838 Professor p, F. v 
gian mathematician, publisheq s (а g 


(Vol. 23 


gesting the use of a curve, which he пещи е 
logistic, to describe the growth of popula У 
His work was forgotten for seventy years, © i 
since the publication of Du Pasquier’s apad in 
1918. the logistic curve has been widely aps 
the study of population gorwth, Since e арт 
a marked relation between the past gums is 
population and the growth of ee a fit- 
not novel to apply the logistic curve in the 

ting of enrollment trend. 


: дү pe given 
The general logistic function may ve 51У 
by 
L (5) 
у= 
“7 1+ те 
ви 
where Фф (t) = 5,6 + 5,12 + Sst3 +.... ‘ment, t 


y denotes Ше growing variable, епго onstants- 
denotes time, year: mı, and S's are A for fit^ 
Several methods have been EVELOR h may 
fing this curve. The first of these, W eas, É 
be called the method of the rate of фиат" 
based upon the fundamental logistic а inear | 
that the percentage of rateof ree | 
function of the growing variable, say creas 5 
We шау calculate the percentage of in e to the 
over successive intervals and plot thes hen; 
enrollments at the end of the intervals, ¿qua res: 
fittinga lineto these points, say by lea. уел ^ 
The application of this procedure 15 5. e calle 
Ноје пе. Another method, which m dby Ver 
the method of selected points, i$ ve method con 
hulst and by Pearland Reed. This ‘stimate 0 
51515 essentially of a preliminary Prot of poin | 
the constants or parameters from à 
The Pearl-Reed procedure for es А 
constants is limitedto five parameter ber 0 
be pointed out, however, that апу i 


У а 5е " 
arameters may be determined by 42 рат 
р у пе п 


) 
Tr 2 09): | 


timating ould 


me M(t). р-у 
у -у- 
а 


Ф (9) = log (L -y) - log m - log У 


Since Q(t) = S,t+ Sueos a sunat 


Let log m = Sg S 
Then бо + 8,t + St? +.........: ев 


у ше 

h 
| throug gy 
Now if the selected n+2 points paS tersi Sor ! 
Curve we can determine n+2 parame (ong: | 


СОИ Sn and L by Ше following ей 


Зо - log L - Уо =o 
уо 


Магеһ, 1955) 


5 2 
Ot 51 + В +.......... " ва -logl-Yi-o 
yi 


Бут ОРЫГ + ts, - log Г-Уг-о 
Уг 


So + t Р 
nS, + ОВ Мез ын ына + tnSn ~ log Ул-о 
Уп 
ott 2 
п+18, + (18, +...... НЭРС 
L-ynd 0 
Уп+1 


Тһе V; 
i m poke parameters may be denoted 
апу of the ils эн minants or сап be obtained by 
neous eae, raic methods for solving simul- 
The Solutio ions, such as the Doolittle method. 
as a first = of these equations can be treated 
istic cur, e PrOXimation to the best fitting log- 
given py Тр better fit is desired than that 
Seco ap хар Selected points, we may use the 
Squares of ur эмир by minimizing the sum of 
е терелеп 23194215; and the process тау 
sq? not 2 number of times. This process 
ачатев i minimize the sum of the 
th ected ed differences between the observed 
Біз Procedur alues. Hence, strictly speaking, 
оа о PE as called by Pearl and Reed the 
th ure in ч Square, is not true least square 
Въ SB saure ARUM] Sense, (На: ВЕЩА of 
hultz (ref. m fitting are given by Henry 
5 Booq е . 
e 99 sis Statisticians and mathematicians 
Wen уе for the lands have attempted to devis? 
of 27 erma growth phenomenon. Mitscher- 
fing Мапа ium Robertson of Australia, Yule 
ары УҺ. The 1 used а type of curve to de- 
Заре bility of зас is no demonstration of the 
Эй е ат curves, so far as I am 
ant to T Ojectin меці growth. 
the 10 Observe future enrollment it is import. 
АЙ Which. hether or not the curve fitted 18 
the Mess of ЧСП ought to be fitted, The test of 


e iti 4 : 
esengo! ment vs desirable in order to see if 


о о de опе 
Pegg, Snt : 
depon y int long period often becomes іп” 
May „Чеп үд, cult because of a good many in- 
Ње keg, р 2Ыез, not knownat present, whic 


labie dictions in the future. In sucha case, 


When аз ti ecome i в re- 
n 1 cumulatively les 
м : one farther and farther. Hence, 
Tete, V fitteg ent growth curve has been suc- 
it 15 


e 
men Table to c to a long series of data, 
o, аре the estimated en? oll- 
rt period of years as a tentative 
estimates may be proved to be 
Sirey, Ог most practical purposes, but 
Mstances may modify their accur~ 
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It appears to me that the problem of fore- 
casting in statistics seems to be pretty much 
the same as the problem of being in philosophy. 
All of the famous philosophers had failed to solve 
the problem of being: Plato tried to solve itand 
failed; Aristotle triec and failed, In the field of 
sciences, many statisticians and mathematic- 
ians had tried to solve the problem of future 
and failed. For instance, Professor Verhulst 
himself had failed in fitting the population of 
Russia from 1796 to 1827 to a curve and aban- 
doned the investigation of the curve of population. 
More recently Dr. T. C. Hungate of the Teach- 
ers College of Columbia University failed to 
prophesy the total college enrollment of 1950 in 
his book, Financing the Future of Higher Educa- 
tion, which was published in 1946. Professor 
R. S. Vaile of the University of Minnesota failed 
to foretell the 1948 enrollment in his article, 
«gpnrollment After the War, ” published in 1944. 
The failure of forecasts from a curve to agree 
with the actual enrollment may be due either to 
the choice of the wrong type of curve or to our 
inability to control ай factors in operation. Sta- 
tisticians have lost their reputations by fore- 
casting an uncertain event, such as predicting 
future college enrollment. Whenever this hap- 
pens, there has been often а tendency for people 
to draw а hasty conclusion that statistics is no 

{ this widespread criticism on 


ood. In view © Ї и 
statistics, it is deemed advisable to point out 


that there 15 по necessary relation between the 
odness of fit of а mathematical curve and its 
5 recasting. А curve may fit the 


jabilit’ for fo: а š 
ат data for the past fifty years wita а 


1 ree of accuracy, and yet fail to predict 
high enrollment for the for the next year 
о forecasting of future enrollment 15 not 

i ns a statistical problem and therefore per- 
см пеуег сап ре зешед һу statistics alone. 
та statistical estimate gained from the study 

ollment records must be supplement- 
dge which may be quite non- 
The factors actually гер- 
end are very com^ 
resented еше to analyze. In fact, the future 
llment involves the operations ic a 
ber of factors. For example, 
patner cu P ‘registered students ina given 
е may be large or small depending upon 
a” in international situations and in the ес- 
change? о иол, veteran enrollments, birth 
high school enrollments, unusual migra~ 
та т ovisions for educational benefits, poli- 
tion, Рг cerning student deferment and many 
numerous factors. Some of these factors 
Өш erate continuously for а number of years 
өн ще may drop out temporarily ог регша- 
ana iy while some unknown new ones may make 
пет appearance in the future. Шарреаг5, 
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therefore, impossible for the statisticians to 
control all new factors unknown to them andcon- 
sequently every statistician may make errors 

in probabilities at times. 

In a certain sense an enrollment trend may 
be considered as an established habit; it is like- 
ly to continue, but other factors may change it. 
The element of personal judgment based upon 
an understanding of the factors affecting the en- 
rollment is always invaluable. Each colle ge 
Should study most realistically its enrollment 
outlook in the light of past, present and future 
conditions which are likely to affect its enroll- 
ment record. If and when some estimates of 
the future enrollment must be made and noother 
device can meet the need as effectively as the 

fitting a trend, then projecting future enrollment 
under normal growth conditions by curve-fitting 
procedure as suggested in this paper may be ex- 
ceedingly useful for the practical purposes. 
Finally, it should be realized that the object of 
forecasting enrollment is not to determine а 
curve that will tell exactly what must happen in 
the future years, but it is to make a careful an- 
alysis, Базей-оп an appropriate statistical tech- 
nique, which will enable the administrator to 
take into account future enrollments to a great- 


. Verhulst, P. Е. ‘‘Notice Sur 


(Vol. 23 


er extent than he could without them. 
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AN APPLICATION OF M 
: ULTIPLE REGRESSI 
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THE 
t PU 
9 show hoy 2 E of the present article is 
applied to s e regression analysis can 
sending and basi а1 the relationships between 
А grade (th Skills as measured in the 
эң їп nb ac independent variables) and 
iam at the hi in phases of the academic pro- 
ables) igh school le 
tion g: Рог со vel (the dependent var- 
i the reader mplete results of this investiga- 
of res completed ; referred to a doctoral disser- 
parti, Study was іп 1954,1 The main purpose 
thej ial regressi to determine the significant 
T Share of lon coefficients and determine 
he stuay шэн accountable variance. 
reading "Ong was designed to find the relation” 
118 abilitie Sured areas of seventh-grade 
теаз of the n» study skills and the con- 
ustin py, ЧЕН School. The students of 
the со, 115 study chools constitute the popula- 
iste ЛС lusiong a. It is to this population that 
с еты drawn. The samples con^ 
55. Data we from two seventh- grade 
Cords of Ux obtained from the perma- 
1952 ЖШ 55 а The first seventh- 
у S nih- s in the dis 1947 was tested again in 
3s Brade was сал grade. Тһе second 
s ed i За 
рир; in the ni іп 1949 and again in 
is а їшс144 ninth grade. The samples of 
S in SUS in the 22 the study, consisted of 
Se group (7- E 
iter ts War group (1-3) Хан 
бур, белсе тол Ве study were the California 
Вац Ор Gra 6515, (non-la 1 
том Ski rades 9 ( n-language section), 1946 
5 ot Ша, Rap о Adult; the Iowa Tests of 
me Нет Educar 2 and Form R; and the Iowa 
Sadi nal Development, Form Y~2- 


а 

the Sur hal cur 

ent Seve b а pede and work study skills 
Vay th owa Tests of Basic Skills in 


Ari ra 
lables de and their notation (Independ" 
X Vere as follows: 
1 Besos 
X» nae Comprehension 
ing Vocabulary 


i The Relationship of 
e Interpretation of t 


X3 
ха 
Х5 
Х6 
X7 


T1 
X8 
X9 


T2 
X10 


X11 
X12 
T3 


The meas 
school level, 
Jowa Tests 0 


ent Variables), 


Y1 Understan 
Y2 Background 1 


Map Reading 

Use of References 

Use of Index 

Use of Dictionary 
Reading Graphs, Tables, 
and Charts 

Total Work Study Skills 
Usage (language) 
Spelling 

Total Language Skills 
Fundamental Knowledge in 
Arithmetic 

Fundamental Operations 
problems 

Total Arithmetic 


ures in content areas at high 


as obtained from scores on the 


f Educational Development (Depend- 


were as follows: 


ding of Basic Social Concepts 
n the Natural Sciences 
and Appropriateness of 


Y3 Correctness 
Expression 
y4 Ability to do Quantitative Thinking 
Reading Materials 


M5: 


Ability to Interpret 
in the Social Studies 


Y6 Ability to 5 

in the Natural Sciences 
Y7 Ability 
yg Genera 


Interpret Reading Materials 


to Interpret Literary Materials 


1 Vocabulary 


Total of Above 


Ү9 
y10 Use of 
mption underlying the validity of the 


The 4550 


iple regression а 


Sources of Information 


nalysis is that the 


multi 
use of variable is normally distributed and 


сот 
These 


ssion of the dependent variable on 
bination of independent variates 

assumptions Were tested ет- 
lotting the dependent variables on 
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normal probability paper indicating normality 
by a straight line relationship. 

In order to handle the large amount of data 

efficiently and accurately, it was transferred 

to the Hollerith card which permitted the ma- 
chine calculation of the Squares, sums of squares, 
and cross products essential to the multiple re- 
вгез510п analysis, 

The first step in the analysis of the data was 
to determine the zero order correlations and 
test their significance at the one percent level 
of probability. Тһе null hypothesis that the cor- 
relation coefficients are not Significantly differ- 
ent than zero was tested, 

Two main areas were investigated in each 
grade using the independent variates and depend- 
ent variables listed. The first multiple regres- 
Sion analysis was set up using X1, Xo, X3; Ті, 
T2, T3, and their relationship with each of the 
dependent variables Yı to Y10 determined. The 
Second analysis was made using X4, Xs, Xo, 
X7, and Xg in a similar manner with the depend- 
ent variables, · It is important to point out at 
this time that no relationship between the two 


may exist between each of the Work study skills 
and the dependent variables, The second main 
агеа was a repetition of the first performed an- 


alysis for grade eleven conducted in a similar 
fashion, 


An Example of the Application of Multiple Re- 
ression Analysis in Calculating the Readi 
апа Study Skills Related to Yo 


The regression equation is in terms of the 
population values or parameters, The best ез- 
timates of these parameters are obtained from 
The partial regression co- 
the Weighted Contribution 
t variate makes to the total 
pendent variable, The equa- 


° а unit change in anyone of 
чө rid Variates, рн factors 
сена indie Же жт а best estimate of future Suc- 
considerabin з under investigation is of 
the teaching M to those Concerned with 

The Correlation betwee 
пе we are trying 
obtained by usi: 


п the criteri - 
b predict, ion, or val 


and the prediction 
= ees for the 
tiple Correlation Coeffic 3 The ка cone 
relation Coefficient give n dire ре ще 
of the goodness of fit of e multi ie “masa 
model. It is an indication of d ч еы 
relationship between the actual Scores: Ж a ur 
ni e 
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best predicted scores. А test of SEA EN 
nificance was applied to all multiple corre e 
coefficients at the one percent level of Ld 
ity. If the coefficients were found not ape 
cantly different than zero the relationship we: 
be attributed to the operation of chance "E 
The square of multiple correlation rcp ед 
gives an accurate measurement of the to із 
amount of variance of the dependent yari сот” 
mathematically accounted for by the liges dte 
bination of the independent variables. The ul 
rect contribution of each variate is pte 
from the square of the standard partial A por- 
Sion coefficient for each variate. A apt on 
tion of the interpretation of results is 

i A у а- 
ae logical step after finding poe 
ing abilities and skills apparently = to test 
particular high school content area а нап {һе 
the significance of each relationship. dion the 
above relationships cannot be explaine е said to 
basis of sampling errors alone they Е conse" 
be statistically significant and are, аа ца Но. 
quence, retained in the regression À tablished 
An arbitrary probability level was "= asa of ге 
at the five percent level for the еме ста 1 
gression coefficients used in determi 2 
assignable variance. ired for its $9" 

The problem investigated cepe the exi 
lution, not only the establishment о abilities 
ence of a relationship between кода ia school 
апа skills and the subject areas in “Мир two 
but the extent of that relationship. | to the 10 
or more abilities may be contributing in high, 
tal variance of the dependent varia 9 опт, 
School it must be ascertained if they and to wh& 
Similar amounts, different amouns, icien , 
degree. All partial regression ama ре еп 
stable at Ше five percent level, ОТ dictated y 
level of statistical significance аз further t 
the problem solution, were tested | the аточ? 
termine if there was a difference "Diem. 
of variance accounted for between the bas 
differences can be accounted for on t possibl 
random errors of sampling, it is пе іле! пе. 
to make any definite statements # 4 py each Git 
unique amount of contribution ma ot be co 
If the difference between them pore tha пех. 
ed for by sampling error, it is ap the oF of 
may make a greater contribution ount 08255 

The method of determining the Ad variam Se 
tribution of each variate to the tota artial n 
Shown in the sample analysis. The алдат 
gression coefficients are changed a , pea 
Partial regression coefficients, Square пей, 
the percent of assignable ухна =" in the 
The calculations have been comple éd. n 
ample to illustrate the procedures Е рио ре 

Steps commonly followed іп the 5 stable ig^ 
9f a multiple regression problem 1n ti tica! 
lution at the five percent level of sta 


9 


March, 1955) 


af 
елата the regression coefficients are not 
computati may be found in other sources. 2 The 
the Partial rc below carry the solution on using 
Significant, Тергеввіоп coefficients found to be 
at the E In the example used it was found 
Pendent 211041 regression coefficients for inde- 
(Tota Primis T1 (Work Study Skills), T3 
ere si ithmetic Skills), and X3 (Vocabulary) 
Snificantly related to У2 (Background in 


Natura] 
Scie 
е variance” and accounted for 51 percent of 


0 М 
the Ur first 


Partial Tequirement is that of converting 


Partial ге regression coefficients to standard 
Quireq in gression coefficients.3 This is re- 
dependent rder to render the measurements in- 
tion is шэг Scale. Тһе process of transforma- 
resents p се below where A(i = 1,2,3) rep- 
ы ресе Standard partial regres- 


Sion сое 
А = 
15.1301 / т . 1301 /65714. 7343 . 3929 
У 7203.2773 
B, ~ 
1071 / 13 „1071 /24153. 4960 _ 1963 
2 7203.2773 
35.05 
22/33 =. орг /88114:3398 . 1877 
3 7203. 2773 


в 


! 
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à 
We next square each of the standard partial 
regression coefficients and calculate the propor- 
tion that each square constitutes of the total var- 
iance, i.e., Её. (See table below.) The change 
to a percentage basis is indicated in the third 


column. 


Summary and Conclusions 


Multiple regression analysis was applied to 
determine the relationships among seventh- 
grade reading abilities and study skills and 
achievement in the content areas of the high 
school. 

After running the usual analysis and finding 
the partial regression coefficients stable at the 
five percent level of statistical significance, fur- 
ther treatment was applied to determine the ex- 
tent of the relationships. This was accomplish- 
ed by testing the significance of the difference 
between partial regression coefficients to азсег- 
tain if a real difference in their respective соп- 
tributions existed or if it could be accounted for 
by random errors of sampling. An example 
was shown illustrating the method of calculating 
the percentage of the total variance accounted 
for by each component. The above procedures 
used in treating the data were of basic import- 
ance in the interpretation of the results. 


gp? proportion Percent 
„6767 67.6 
Ті: Work Study Skills ides . 1688 16.8 
x3! Total Arithmetic Skills 0305 1543 15.4 
3: Vocabulary E „9998 99. 8 
2 
MUS . prentice-Hall, Ince, 1949), 377 рр» 
ЭР то. Johnson. Statistical Methods in Research (New York: Pren 
alni ` зае — " Journal of Educational Research, 


er o 
is (Octo eohnson, "The Differential Functi 
т 1936), рр. 93-103. 


ons of Examinations, 


A REDUCED ЕОВМОГА Е ОВ POINT-BISERIAL 
COEFFICIENT OF CORRELATION 


WILLIAM O. BUSCHMAN 


Portland State Extension Center 
Portland, Oregon 


ао б Е THE most common types of 
analysis ar са ке пр for Ше purpose of item 
The fini T iserial r and point-biserial r. 
ltem is ын these, biserialr, assumes that the 
continuous and by a dichotomization of a 
t the eaters normally distributed variableand 
Sarily nor rion is a continuous but not neces - 
assumption variable. Whether or not these 
able, Riche Сап be justified is often question - 
dicate dichardson and Stalnaker (5:463-64) in- 
ure for ite the biserial г is not a suitable meas- 
dichoto m analysis where the responses are 
the distributi ed because it assumes: (1) that 
normal, ШОП of the dichotomized variable is 
is continas that (2) the dichotomized variable 
conditions us. They indicate that unless these 
fit the сав сап be established and be shown to 
ial r is peg being studied, that use of the biser- 
Ызена ОС warranted. In such cases the point- 
съв more Suitable. 
tired оо хи. computations which аге ге- 
ane a т eee of item analysis have 
cien h Бас e to their use. In order to 165 
ly ni парап чс сарыш the biserial coeffi- 
rad, e] T тоза ee eran (бе 
and 80). Dunlap Der Portions of the group (3: 
ing ghe 8 = (2:51-58), Chapanis(1:297-304) 
bise he amoun Proposed methods for shorten - 
rial | of computation in determining the 


fer: ind 
able нех. Such shortened methods аге рге” 


Ang; lev s 
а Зоте Y Yield equally satisfactory results, 


: са, 
Gin до 8 in Яо. may be preferred because of 
fo ace and effort even though a сег- 
2 ч lord. may be sacrificed. Are- 
i hy and е point biserial coefficient 
* given Doint-pis ож below. 
by the P iin Coefficient of correlation 

owing formula (4:353): 


M, -Mi а) 


h бы s= B 
Which трь с Ура 


е 
mea 
Sm, П Score of the individuals pass- 


My 


item 
» 


the 


the 
me 
ап score of individuals failing 


tri Ор = 
ibu, к th 
ti е зы 
On о hn T deviation of the total dis- 
S, 


p = the proportion of individuals passing the 
item, 

а = the proportion of individuals failing the 
item. 


For purposes of comparing the validity of items 
test and not for comparison with items 
on other tests, the reduction to standard form by 
division by от is unnecessary and may be omitted. 
This gives what will be termed the reduced point- 
biserial coefficient of correlation. The formula 
for this may then be written: 


ona single 


= (Mp - Мұ) Ура 


Trpb Q) 


The difference Mt - М; is as adequate as My - 
М; (1:303). Thus Ше formula can be expressedin 


the alternative form: 


Tipp = (M, - Mj) Ура (3) 


in which Mt is the mean of the total distribution 


of scores. 
If deviations are taken from the same step in 
each case, then the means М and М; may be ге- 


iati from 
laced by the deviations of the true means 
the е means as the differences will be can- 


celled in the subtraction Mt - Ме The formula 


b expressed: 
siu эж 
Ne Ї їр 


грр 5 


in which Nt represents the total number ofscores 
and № the number failing the item. This is a more 
usable form than either (2) or (3) above. Further 
simplification of the computations are possible by 
taking the deviations (d) in terms of class inter- 
vals since the class interval is constant through- 
lem. If the zero deviation is taken at 


out any prob 3 ; 
the lowest interval in which any frequencies occur, 
the negative deviations may be avoided. 


The reduced formula will give values which are 
just as accurate and adequate as the formulas from 
which they are derived. Though results can be ар“ 
plied only to the problem on which the values are 
computed, this is the way in which this coefficient 
is generally used. If comparisons with other sets 
of data are sought, the data obtained by the ге- 
duced formula can be converted to the conventional 
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formulas, but only in rare cases wouldthis 
furnish useful information. 

The development of the reduced formof the 
formula for the point-biserial coefficient of cor- 
relation (4) will make it easier to use andapply 
this coefficient to those situations in which it is 


the most suitable of the several measures which 
are used for item analysis. 
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PREDICTION 0F THE PROBABILITY ОЕ 
GRADUATION OF ENGINEERING 
TRANSFER STUDENTS 


y. STANLEY AHMANN 
Cornell University 


THER Е А 
РА. that estes doubt in the minds of College enrolls sizeable numbers of transfer 
саз, the тешен. of today is deeply inter- students each academic year. Estimates have 
onstr examination 7 of the future. Evena de that as many as 40 percent of the en- 
ucati ates the willin the literature readily dem- eering students at the beginning оға 
; n to gness of investigators in ed- had гази volgr credit from 
higher learning. The per- 


been mà 
tering engin! 
fall quarter 


i de у 

tha ttempts to ae considerable time and effort other institutions о ; 

data ucational 212 their ability to predict cent of the engineering graduating class who 

have D. today, s 2 tomorrow from known were originally transfer students has been as 

fut een made p cifically, repeated studies large as 50 percent on occasion. 

thos ёасаа4еш to determine estimates of the In the light of these figures alone, further in- 

шеас estimates Ба achievement of students, vestigating of the collegiate academic careers 

aptit ез as sch eing based upon such present of the transfer students entering engineering 

ed sc ера ріп aptitude, mechanical would seem warranted. In addition, college of- 
Tho Stic ар » and previously demonstrat- ficials and transfer students have repeatedly in- 

to pr is evident шу. quired about the likelihood of a student's aca- 

p, теш hat the results of these efforts demic success in engineering after transfer. The 

answers to such questions have been shrewd 


+ 1! 

Шери? most : 
һау Ple, of which ha 
Sty assisto correlation and | дет uesses at best since few adequate tools have 
Бал, ў тре instructors eed ны, бар developed which will reduce to administra- 
Ме Ting equ 15 true for the п ^ а un eme tive routine Ше prediction of a transfer student's 

Redlegs "C cation а, most part in demic success in the Engineering Division. 

S wellas in other areas. аг the purpose of this study (1), there- 

was X 
trument to predict the prob- 


Y, however, the de f assis- 
St stum ed greatly, ' Ends Оаа” e, to devise an ins 
pden р concerning D mple, p S ДЫ ШЫ of academic success in engineering of 
esp, P ЗЄВ e Comparatively few i pons students who transferred from other institutions 
сац nun is the transfe = Rs umber. of higher learning. For the purpose of this study, 
Son though е transfer stude Жэн Өш ЕТО academic Success has been defined in terms of 
log, Ment education research ~ аланы! E transfer student eventually graduat- 
Sit als teng Ported in the ЕЕ and editoria ed in engineering at the Iowa State College. It 
Verge Of ty to exclude th gher education should be noted that this dichotomous criterion 
den titles ара er student. e question of the ро” of graduation-nongraduation differed from the 
mane 15 EA he importa nts in colleges and uni- usual numerical criterion of course marks or 
опу, езді nce of this group of stu- cumulative grade point averages used in regres- 
However, the definition here 


Y increasine i гі 
ng in the opinions of sion studies (4). 
ed to be reasonable in lightof 


ang anq a Sngineer 
Coy org p nistr: ng, for example, instruct" is consider 
w leges m ře "PS апка аге becoming more сила Bat some engineering faculties seem to 
Че. first ade by the е impact on engineering ре more interested in whether a student gradu- 
Whigs Í hi egan their undergraduate students ates in engineering than whether he attains some 
аса ћ they er learni college studies at institu- mamerical academic average above the minimum 
Sug} Mic Ultimately I other than the onefrom required for graduation. Furthermore, in view 
5 an, Stude Social r уе to graduate. The of the present day shortage of trained engineers, 
nstp ther nts тн justments to be made by certain industrial concerns are inclined to con^ 
Pon орь, Te often, ansfer from one institution sider а student’s ability to graduate in engineer^ 
тетер 3nd соц genuine problems for the ing from à specific institution as adequate dem- 
he A. nselors of both institutions | emstration of academic achievement, Lastly, 
| such а smple Attili hp nein e BONIEVE~ 


ЦЭР" 
lon of Engineering at the тома State 
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eals to the entering transfer student 
=н a day may be counseled оп Ше basis of 
these results. 2 

Prediction of the probability of graduating in 
engineering was based upon various combinations 
of test scores compiled by the psychologicaltest- 
ing program, the high school grade point aver- 
age, a rating of the student's previous collegiate 
academic achievement, and the first quarter 
grade point average in engineering at the Iowa 
State College. Inall, six prediction variables 
were considered. Four of the variables were 
assembled as a matter of routine and were avail- 
able prior to the date on which the transfer stu- 
dents began their studies at the Iowa State Col- 

lege. They were the linguistic raw scores and 
quantitative raw scores on the American Coun- 
cil on Education Psychological Examination 
1945 Edition, the high school grade point aver- 
ages, and the raw scores on the United S tates 
Armed Forces Institute Test on Correctness and 
Effectiveness of Expression, College Level, 

The fifth prediction variable which also was 
available prior to the beginning of the transfer 
Student's Iowa State College studies, was a rat- 
ing of each student's prior college achievement 
as represented by the transcript of his credits. 
This rating was made оп а Six point scale by 
clerks in the admissions branch of the regis- 
trar's office, and was based upon the type of 
Courses previously completed by the student, 
the final marks he received, and the engineering 
curriculum he was entering at the Iowa State 
College, 

The sixth predictio 
quarter grade 


Scale. 
Although the 
closely those used in ге 
criterion, the tendency 
ing, was a dichoto 


aratio 
groups, each of which is poda ая еп Ево 
ally distributed, Тр the case E О be norm- 
terion maximum Separatio ! 
but within а single normally qe also desired 
which had been divided into 4 dichotomy” Toup 
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а 


The foregoing assumption that the pesi 
to graduate in engineering is a single 2 маи 
distributed variable necessitated а modifi ший 
of Fisher's discriminant function, such pe dm 
fication having been reported ша m This 
textbook by Wert, Neidt, and Ahmann | Жэ 
modification yielded a prediction equa ue wi 
sembling greatly the regression e iuge "made 
the major exception that the prediction бэрээ 
in terms of chances іп 100 of graduat nE өші 
gineering rather than in terms of qaia ді” 
Scores. The general form for Ше mo 


eum iables is: 
criminant function of m prediction varia 
+ С 

Vo = a,X, + а;Х, + азХа +....+ ашт 
where 

Vo - sigma units 

а = coefficients РА 

X = prediction variable scor 

С -constant 


ва 
: í the рг 
Substitution of the appropriate values 0 


за ms 0 

Cition variables yields a prediction af the norm” 
sigma units. By consulting a table rer te аю 
al curve, Ше sigma units аге conv 
сһапсез іп 100. ficients 

To determine the size of the coef 3 ediction | 
which would yield the best osa 2 
equation, data was gathered for 80 а since SP 
eering transfer students who ppm p 
tember, 1946, and who at a later at by 
nently left the Engineering Division, : 
means of graduation or dropping out: orld We 
over three-fourths were veterans ts hadatten a 
П. In general, most of the pur rele atthe Io i 
ed only one college prior to епго! "une: y lorga 
State College, and the college (ни enrolled а 
ей in Iowa ог an adjacent state ап опе- ror’ 
than 2500 students. Approximately Певез bë uic 
the students first attended junior es first та 
transferring whereas the remainde college iat 
ulated at colleges other than junior dicate 

Since earlier research (3) has in 
veteran students tend to surpass по 
students in academic achievement, 1 
Вгоцр of 804 was so divided. In Ч m 
inary investigation of the availab 1 differen + 
the possibility that, when individual i; fai 
аге ignored, those transfer gab great? se 
attended junior colleges experienc ын с 
ficulty in graduating in engineering ог, 
Who first attended colleges other this situat 
leges. Although the reasons for and non^ 
Were not determined, the veteran ар ratifi? ig 
eran transfer students were furthe result? 
on the basis of college status. The 
four subgroups were: сев 

: пе 

1. Veteran students from junior C? 

(k - 207) 
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TABLE II 


WITHIN SUBGROUPS BISERIAL CORRELATIONS BETWEEN 
THE CRITERION AND ALL PREDICTION VARIABLES 


Biserial 
Prediction Variable Correlation 
Linguistic Score on ACE Test .187 
Quantitative Score on ACE Test .296 
High School Average .312 
USAFI English Score .281 
Admissions Office Rating .396 
First Quarter Average .655 


a a 


TABLE Ш 


MULTIPLE BISERIAL COEFFICIENTS OF CORRELATION RESULT- 
ING FROM VARIOUS DISCRIMINANT FUNCTIONS 


Combinations of 


mbi i iserial 

Prediction Variables kc 
Q-score, High School Average 380 
Q-score, High School Average, USAFI Eng, 399 
Q-score, High School Average, USAFI Eng., Rating  .480 
Q-score, High School A: 

à verage i 

First Quarter Average жаа, TM 686 


Нийлэг 


(Уо1. 23 


B. = 


‘Tune, 1955) 
АНМАММ 


TABLE IV 


CHANCES IN 100 OF GRADUATING IN ENGINEERING FROM 
PRE-MATRIC ULATION DATA 


ACE Q-Score percentile Rank 


zu Sub- 
ve. Group* 1-10 11-20 41-50 51-60 81-90 91-100 
1 13 15 18 19 23 26 
Ли 2 6 8 10 10 13 15 
г 3 21 24 29 30 35 38 
4 8 10 12 13 16 19 
1.60 1 14 16 20 21 25 28 
Tos Я 7 8 11 11 14 16 
a 3 23 26 30 32 37 40 
4 9 11 14 14 18 20 
1 19 22 26 28 32 36 
c д 10 12 15 16 20 22 
um 3 30 33 38 40 45 48 
4 13 15 19 20 24 27 
1 28 29 34 38 
2.19 3 32 35 40 42 47 50 
4 14 17 20 21 26 28 
38 39 45 48 
3.60- 2 17 H 24 25 30 33 
3.79 з 3 Эр 51 52 58 61 
4 21 94 29 30 35 38 
40 41 47 50 
3.80- 5 31 35 2 21 31 35 
400 з М оо 53 54 60 63 
4 23 26 31 32 37 40 
ж 
ТЕ 
9 < Veteran, junior college 
3- Non-veteran, junior colle£e 


4 Veteran, other college 
= Non-veteran, other college 
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TABLE V 


CHANCES IN 100 OF GRADUATING IN ENGINEERING FROM FIRST 
QUARTER GRADE POINT AVERAGES 


= 
1st Quarter 


Average Subgroup in 100 


0. 00-0. 19 


нъ CO м на 
- 
о 


0. 20-0. 39 


> Со № н 
= 
со 


> CO М n 
A 
г 


2.00-2.19 


қ со кә 
> 
a 


> со B2 а 
a 
~ 


M» CO № = 
a 
e 


(Vol. 23 


Толе, 1955) 


2. ” 
Моп гаи Students from junior colleges 


3. y 
| и students from other colleges (К = 
» Non-vetera 
n Students fr 
(k = 122) om other colleges 
Examinat 
that e ui of Table I readily reveals the fact 
Criterion an ы ді tended to respond to Ше 
erefore aor СИН, The stratification was 
Analysis, intained throughout the statistical 
Sinc 
four а Sample had been stratified into 
between hel to determine the relationship 
each of еа | to graduate in engineering 
Subgroups ре Prediction variables, within 
Were com rrp coefficients of correlation 
relatio uted and are listed in Table П. АП 


nshi 
ferent a ө ы found to be significantly dif- 


Modifi h 
combinata discriminant functions using various 
Computeq “oh о the prediction variables were 
ре bis Within the subgroups and yielded 
qicative of linn Coefficients of correlation in- 
ti as шры predictive ability of each scheme. 
10 Score hon discovered that the linguis- 
ТЕХ ination un dropped from any prediction 
the In abiit 1 hout incurring an appreciable 
iine Various ка © predict. In Table IIIareshown 
ae the result tone of prediction variables 
of океанов, "5 multiple biserial coefficients 
igng ability fo The correlations are indicative 
the teq Subgro predict for any of the four des- 
fic; Өгерорры Ра а Since, in the case of any of 
app б ща iscriminant functions, the coef- 
Зак, priate pegic tm) to be multiplied by the 
stan, 10г each ediction variable scores were the 

ЧЕ (С) chan Subgroups. However, the con- 
e» C dictio Sed with each subgroup so that 

Е. nS vary from one subgroup to an- 
а То facilita Б р 

n 
sei notion ee application of the discrimin- 
Стад Š Of stude nique for such persons as coun- 
ч dis ting ee tables of chances in 100 of 
table  iminant о Computed by repeatedly solving 
пъ а Serj function. By means of a single 
ы Pidy да of related tables а counselor 

ermine a transfer student's prob- 

Varian Or tp № in engineering by entering 
Шаде Р scope 5 With the student's prediction 
ие the bas; If the prediction were to be 

or 4 à is of two prediction variables, а 
vari 

orbles, two tables are necessary. 
474 in 4, less (probability tables to be consult- 

leto? the preg -2 the number of variables to be 
be tt П varia diction when more than one рге” 
ера? Prior р © 15 involved. 
the date that a transfer 


Чез oies at и it 
ble © 41 the Iowa State Colleg% ^... 
* to predict his probability of grad 


Sda 


student 


AHMANN 


ble 
The three Ch as Table IV would be sufficient. 
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Lr in engineering on the basis of his quanti- 
ive score and high school grade point average 
a counselor could easily do so by means ofa ! 
table such as that partially shown in Table IV. 
Because the quantitative scores are usually 
available as percentile ranks, the table was 
constructed accordingly. 

The probabilities were computed for each of 
the four subgroups, ranging from 6 chances in 
100 for the least qualified students to 63 chances 
in 100 for the best qualified students, and vary- 
ing appreciably from subgroup to subgroup. In 
using the table the counselor would classify a 
transfer student іп the appropriate subgroup, 
read up and across in accordance with the stu- 
dent's scores, and note his chances in 100 of 
graduating in engineering. This information 
based upon the academic success of an earlier 
group of transfer students with similar qualifi- 
cations, certainly would provide the incoming 
transfer student with a more realistic basis on 
which to evaluate his position. 

If a counselor were willing to wait until the 
completion of a transfer student’s first quarter 
of studies at the Iowa State College before pre- 
dicting the student’s probability of survival, a 
table such as the one shown in part in Table V 
could be used. Table V resembles closely Table 
Iv except that the prediction is now being made 
exclusively on the basis of the first quarter grade 
point average. On the basis of this variable, the 
probabilities of graduating rangedfrom 7 chances 
in 100 to 75 chances in 100. Again the probabil- 
ities differed among the subgroups. 

The application of the modified discriminant 
function technique to the foregoing problem is 
but one of many applications. The prediction of 
the probability of attending college or of passing 
a specific course (5) are examples of prediction 


hich the investigator may wish to 


problems іп w ator may w 
assume that the dichtomous criterion is in real- 


ity a single normally distributed variable. H, 
as in the case of the prediction of the probability 
of graduation, the ability to predict is found to 
ре sizable, certainly the application of the tech- 
nique to these and similar problems provides 
the instructor, the administrator, and the coun- 
selor with still another valuable tool. 
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